AD-A214  993 


AN  EVALUATION  OF  THE  UNITED  STATES  AIR 
FORCE  NETWORK  REPAIR  LEVEL  ANALYSIS 
MODEL  AS  A  TOOL  FOR  ROYAL  AUSTRALIAN 
AIR  FORCE  REPAIR  LEVEL  ANALYSIS 

THESIS 

John  D.  Eckel ,  8.  Eng  (Comm) 
Squadron  Leader,  RAAF 

AF I T/GLM/LSM/89S- 1 7 


distribution  statement  a- 

Approved  (or  public  release; 
Distribution  Unlimited _ 


DEPARTMENT  OF  THE  AIR  FORCE 

AIR  UNIVERSITY 


DT1C 

ELECTE  M 
DEC  0  6  1389 1  I 


Ob 


E 


AIR  FORCE  INSTITUTE  OF  TECHNOLOGY 


Wright-Patterson  Air  Force  Base,  Ohio 


89  12  05  3.45 


AF I T/GLM/ LSM/89S- I  7 


AN  EVALUATION  OF  THE  UNITED  STATES  AIR 
FORCE  NETWORK  REPAIR  LEVEL  ANALYSIS 
MODEL  AS  A  TOOL  FOR  ROYAL  AUSTRALIAN 
AIR  FORCE  REPAIR  LEVEL  ANALYSIS 

THES  I  S 

John  D.  Eckel ,  8.  Eng  (Comm) 

Squadron  Leader ,  RAAF 

AF I T/GLM/LSM/89S- 1 7 


Approved  for  publ ic  release;  distribution  un I imited. 


The  contents  of  the  document  are  technical ly  accurate,  and  no 
sensitive  items,  detrimental  ideas,  or  deleterious 
information  is  contained  therein.  Furthermore,  the  views 
expressed  in  the  document  are  those  of  the  author  and  do  not 
necessarily  reflect  the  views  of  the  School  of  Systems  and 
Logistics,  the  Air  University,  the  United  States  Air  Force, 
the  Royal  Austral ian  Air  Force,  or  ihe  Department  of  Defense. 


|  Accession  For 

NTIS  GRA&I 

ft 

DTIC  TAB 

ft 

Unannounced 

□ 

Justification _ 

By- - - - - - . 

Distribution/ 

Availability  Codes 
I A vail  and/or 
Diet  !  Social 


I 


I 


AF I T/GLM/LSM/89S- 1 7 


AN  EVALUATION  OF  THE  UNITED  STATES  AIR  FORCE 
NETWORK  REPAIR  LEVEL  ANALYSIS  MODEL  AS  A  TOOL  FOR 
ROYAL  AUSTRALIAN  AIR  FORCE  rstr'A  I  R  LEVEL  ANALYSIS 

THES I S 

Presented  to  the  Faculty  of  the  School  of  Systems  and  Logistics 
of  the  Air  Force  Institute  of  Technology 
A i r  Un  i  vers  i  ty 

In  Partial  Fulfill  me  n  t  of  the 
Master  of  Science  in  Logistics  Management 


John  D.  Eckel ,  B.  Eng  (Comm) 

Squadron  Leader,  RAAF 

September  1 989 

Approved  for  publ ic  release;  distribution  uni  united. 


Preface 


The  purpose  of  this  research  was  to  evaluate  the 
suitability  of  the  USAF  Network  Repair  Level  Analysis  mode  I 
as  the  primary  Repair  Level  Analysis  tool  for  the  Royal 
Austral i an  Air  Force.  This  is  my  first  major  research  effort 
and  it  would  not  been  possible  to  complete  without  the  help 
of  several  people. 

I  am  deeply  appreciative  of  the  help,  guidance,  and 
encouragement  given  to  me  by  my  advisor  LTCOL  David  E.  Lloyd. 
LTCOL  Lloyd’s  penchant  for  good  research  and  the  proper 
reporting  of  research  is  infectious  and  has  made  this  thesis 
many  times  better  than  it  might  have  been. 

My  thanks  also  qo  to  current  and  former  members  of 
Capital  Projects  Division  and  Directorate  of  Maintenance 
Planning  for  their  involvement  in  the  interview  process.  In 
particular,  I  want  to  thank  Squadron  Leader  Mark  Cassidy  for 
his  help  in  the  initial  stages  of  the  research,  and  Squadron 
Leader  Ken  Henderson  for  his  help  in  reviewing  interview 
quest i ons . 

My  deepest  gratitude  goes  to  my  wife  Sue  who  has  put  up 
with  16  months  of  neglect  and  impatience.  I  appreciate  the 
way  she  has  acted  as  both  mother  and  father  to  our  boys  over 
that  period  of  time.  I  am  looking  forward  to  getting  to  know 
my  f am i I y  again. 


John  D .  Eckel 


Table  of  Contents 


Page 


hr  e  face .  i  i 

List  of  F  i  gures .  v 

List  of  Tables .  v 

Abstract .  v  i 

I.  Introduction  .  1 

Over  v i ew .  1 

Background  .  1 

The  Pr  ob  I  em .  8 

Research  Objective  .  9 

Research  Questions  .  9 

Limitations .  10 

Benefits  of  Research  .  11 

Summar  y .  12 

Thesis  Orginization  .  13 

II.  Literature  Revi  ew .  15 

Over v  i  ew .  15 

USAF  RLA  Policy .  15 

USAF  RLA  Mode  I  s/Me thods .  16 

Detai  led  IMRLA  Procedures .  23 

RAAF  Repair  Level  Analysis  Policy  .  25 

RAAF  RLA  Methods .  27 

Summary .  31 

III.  Methodology .  33 

Ove'-v  i  ew .  33 

Specific  Methodology  .  34 

Research  Question  1  35 

Research  Question  2  36 

Research  Question  3  .  36 

Interview  Limitations  .  38 

Interview  Pre-Test  .  40 

Interview  Questions  .  41 

Summary .  44 

IV.  Findings  and  Analysis .  45 

Over  v  i  ew .  45 

Interview  Questions  .  45 


i  i  i 


Procedural  Questions  . 

Opinions  of  Present  Methods  .  .  . 

Scientific  Rigor  of  Present  Methods 

Research  Questions  . 

Research  Question  1  . 

Research  Question  2  . 

Research  Question  3  . 

Summary  . 

V.  Conclusions  and  Recommendations  . 

Over v i ew  . 

Cone  I  us i ons . 

Recommendations  . 

Appendix  A:  NRLA  Input  Data  Requirements 

Appendix  B:  RAAF  RLA  Cost  Elements  . 

Appendix  C:  CAPPROJ  RLA  Cost  Comparison  Chart 

Appendix  D:  CAPPROJ  RLA  Recora  . 

Appendix  E:  Interview  Respondents  . 

Appendix  F:  Initial  Interview  Questions  . 

Appendix  G:  Final  Interview  Questions  . 

Appendix  H:  Detailed  Interview  Responses 


B i b I  i ogr  aphy 


Figure 


Page 


List  of  Figures 

1.  RAAF  Organization  Responsible  for  RLA  .  .  . 

2.  Equal  Cost  Curves  . 

3.  USAF  RLA  Screening  Process  . 

4.  RAAF  RLA  Flowchart  . 

5.  RAAF  RLA  process  with  Interview  Questions  . 

List  of  Tables 

Table 

1 .  NRLA  -  RAAF  RLA  -  Data  Sources  . 


5 

1  8 
1  9 
28 
42 


Page 

59 


v 


AF  I  T/GLM/  LSM/89S-  7 


Abstract 

The  purpose  of  this  research  was  to  evaluate  the 
suitability  of  the  United  States  Air  Force  (USAF),  Network 
Repair  level  Analysis  (NRLA)  model  as  the  primary  Reoa i r 
Level  Analysis  (RLA)  tool  for  the  Royal  Austral  i  an  A:r  Force 
(RAAF) .  The  research  documents  existing  RAAF  and  USAF  RLA 
procedures,  identifies  drawbacks  of  the  present  method  of 
RAAF  RLA,  establ  ishes  the  improvements  offered  by  NRLA  over 
existing  RAAF  RLA  methods,  and  identifies  possible  sources  of 
data  for  both  existing  and  NRLA  based  RAAF  RLA. 

RAAF  and  USAF  RLA  procedures  were  documented  through  a 
review  of  orders  and  instructions,  and  informal  interviews 
with  repair  level  analysts.  Drawbacks  of  existing  RAAF 
procedures  were  then  determined  through  formal  interviews 
with  RAAF  analysts  and  reviews  of  correspondence  on  previous 
RLA  projects. 

A  comparison  of  the  USAF  and  RAAF  procedures  showed  that 
a  NRLA  based  RLA  offered  improvements  over  existing  methods 
of  RAAF  RLA.  Therefore,  the  final  stage  of  the  research 
identified  possible  sources  of  data  to  support  NRLA  based 
RAAF  RLA. 

The  major  finding  of  this  research  was  that  regardless 
of  which  RLA  procedure  the  RAAF  uses,  data  collection  is  a 


major  constraint.  In  a  first  attemot  to  address  this  data 
problem  possible  sources  of  data  for  both  existing  and  NR LA 
based  RAAF  RLA  have  been  identified  in  t  h  > s  thesis.  Furtne 
study  is  required  to  confirm  these  sources,  and  to  ider'tifv 
me  thods  for  extracting  and  adjusting  data  fr  on  these  source 
to  meet  RLA  inDut  reau i rements . 

Two  recommcndat ions  are  mace : 

a.  that  NR LA  not  be  introduced  to  the  RAAF  unt  data 
collection  difficulties  have  been  resolved,  anc 

b.  the  RAAF  use  of  NR  LA  oe  limited  to  the  ana  /s  s  t  * 
complex  components  or  sud  svstems  where  its  strenotn 
allocating  support  eoui pme  nt  costs  and  s  e  n  s  -  t i v  t  . 
analysis  wi  l  i  contr  i  buts  to  a  better  qua1  it v  R  _  A . 


AN  EVALUATION  OF  THE  UNITED  STATES  AIR  FORCE 
NETWORK  REPAIR  LEVEL  ANALYSIS  MODEL  AS  A  TOOL  FOR 
ROYAL  AUSTRALIAN  AIR  cORCE  REPAIR  LEVEL  ANALYSIS 

I.  Introduction 

0 v  g  r  v  ! ew 

This  chaDter  provides  the  necessary  background  to 
understand  the  perceived  shortcomings  of  existing  Roya 
Austral i an  Air  Force  (RAAF)  Repair  Level  Analysis  (RLA) 
methods,  and  how  the  United  States  Air  Force  (USAF)  Network 
Repair  Level  Analysis  (NRLA)  model  may  address  those 
shor tcom i ngs . 

The  specific  research  problem  will  be  explained  and  the 
research  objective  and  more  specific  research  questions  w 


be  d e s c r 

i  bed  . 

The 

chap  ter  w i 

II  conclude  with 

an  explanation 

of  the  1 

i  m i  tat 

ions 

and  potent 

lal  benefits  of 

this  research. 

Backqrou  nd 

When  a  new  weapon  system  is  acquired  ov  the  RAAF , 
decisions  mus  t  be  made  on  the  repair  philosophy  for 
comoonents  in  the  system,  A  component  can  be  discarded  on 
failure,  or  repaired  at  one  cf  three  levels  of  maintenance: 
the  operat i ona  level,  in  termed  late  level,  or  depot  level. 

Operational  level  maintenance  is  the  simplest  form  of 


maintenance  and  is  usual ly  performed  by  the  squadron 


operating  the  weapon  system.  Operational  level  maintenance 
is  char ac ter  i  zed  as  requiring  a  small  range  of  support 
equ i pmen t  and  a  limited  use  of  workshop  facilities  (8:7).  An 
example  of  operational  level  maintenance  would  be  the  removal 
of  an  unser v i ceab I e  radio  and  replacement  of  a  serviceable 
radio  in  an  aircraft. 

Intermediate  level  maintenance  is  the  next  higher  level 
of  maintenance  and  usual ly  supports  several  operational 
units.  This  level  of  maintenance  requires  a  wider  range  of 
support  equi pmen  t  and  facilities  then  the  operational  level 
(8:7).  An  ex amp  I e  o  f  in  termed iate  level  maintenance  would  be 
the  testing  of  an  unserviceable  radio  set  to  determine  which 
circuit  card  in  the  set  was  unserviceable  and  replacing  that 
card  with  a  new  one. 

Depot  level  maintenance  is  the  highest  level  of 
maintenance  and  usually  supports  several  int e rmed iate  units. 
Depot  level  maintenance  requires  a  wide  range  of  special  and 
general  support  equipment  and  facilities  (8:7).  An  ex amp  I e 
of  depot  level  maintenance  would  be  the  testing  and  repair  of 
an  unserviceable  circuit  card  from  an  aircraft  radio  system. 

The  process  of  determining  whether  a  component  should  be 
repaired  or  not,  and,  if  repaired,  at  what  level,  is  known  as 
Repair  Level  Analysis  (RLA).  The  formal  definition  of  RLA  in 
the  RAAF  i s : 

The  process  of  ana  I yz i ng  the  economics  of  repair  and  the 

economic  al location  of  maintenance  workload  between 
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available  service  and  contractor  maintenance  facilities. 
(18:1108) 


As  an  example  of  how  the  "economics  of  repair"  are 
calculated  in  the  RLA  process,  consider  the  repair  of  a 
particular  aircraft  component.  This  component  could  be 
repa  i  red  at  either  four  operational  squadrons,  two- 
intermediate  maintenance  squadrons,  or  one  aircraft  depot. 

For  si mp I  i c  i  t  y ,  assume  equal  failjra  rates  at  each  squadron, 
that  the  repair  of  the  component  requires  unique  support 
equipment  (SE) ,  and  that  the  costs  of  the  SE  and  the 
component  do  not  change  for  the  I i fe  of  the  aircraft.  The 
cost  of  a  "discard  on  failure"  policy  wou Id  be : 

( cc a t / i tern)  *  (expected  life  of  aircraft  ( L )  )  * 

(failures  /  year)  (  1  ) 

The  cost  of  any  repair  alternative  would  be: 

[(spares  ccst/year)  *  (D)  +  (»  repair  sites  *  SE 

cost  /  repair  unit)  +  (additional  component  cost 

to  cover  resupply  pipeline)  (2' 

For  a  "repair  at  r  lerational  unit”  po I  icy  the  number  of 
repair  sites  would  be  4  and  the  p  i  pe  I  i  ne  resupply  costs  would 
be  0.  Assuming  that  tne  intermediate  maintenance  squadrons 
are  remote  from  tne  operational  units,  for  a  "reoa"  at 
intermediate  unit'  pal  icy  the  p  i  pe  I  i  ne  resupply  costs  would 
be  more  significant  but  the  number  of  repair  sites  would  be 
reduced  to  2.  For  a  "repair  at  depot  policy"  pipeline  costs 
would  be  greater  then  that  for  the  intermediate  alternative, 
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but  the  number  of  repair  sites  would  be  reduced  to  one.  The 
"economics  of  repair"  process  would  then  select  the  repair 
level  where  the  life  cycle  costs  were  the  I owest . 

Although  the  general  concept  of  RLA  seems  simple, 
difficulties  arise  when  trying  to  allocate  the  proper  SE  and 
pipeline  costs  for  each  of  the  different  repair  alternatives. 
This  is  especial ly  so  for  complex  systems  involving  many  Line 
Replaceable  Units  (LRUs)  and  Shop  Replaceable  Units  (SRUs) . 

An  example  of  a  LRU  would  be  circuit  card  from  a  radio 
system.  A  faulty  card  could  be  detected  with  the  use  of  test 
equipment  and  replaced  with  another  on  the  aircraft  line.  An 
example  of  an  SRU  would  be  an  electronic  component  on  the 
circuit  card.  The  detection  and  repair  of  a  faulty  component 
cn  a  circuit  card  is  usually  done  in  the  workshop  and 
requires  special  support  equipment. 

If,  in  the  above  example,  the  radio  test  equipment  is 
used  to  detect  several  different  faulty  LRUs,  how  is  the  cost 
of  that  test  equipment  apportioned  between  the  different  LRUs 
for  RLA  calculations7  How  are  the  spares  p i pe I  i  ne  costs  for 
LRUs  to  be  related  to  the  p i pe I  i  ne  costs  for  their  respective 
SRUs?  Should  LRUs  be  treated  separately  from  their  SRUs  in 
RLA  calculations,  or  should  LRUs  and  their  SRUs  be  treated  as 
an  integrated  package?  Considerations  such  as  these  have 
necessitated  the  development  of  standardized  RLA  po I ic ies  and 
procedures  by  both  the  RAAF  and  USAF . 


Figure  1  shows  the  branches  of  the  RAAF  that  are 
responsible  for  RLA.  The  Directorate  of  Maintenance  Planning 
-  Air  Force  (DMP-AF) ,  is  located  at  Defence  Central 
Headquarters  Canberra,  and  is  responsible  for  developing  RAAF 
RLA  policy  (10:1).  DMP-AF  provides  advice  to  the  Chief  of 
the  Air  Staff  (CAS) ,  through  the  Assistant  Chief  of  the  Air 
Staff  -  Engineering  (AC AS -ENG)  .  CAS  imp  I emen  ts  RLA  policy 
through  the  Air  Officer  Commanding  Support  Command,  located 
in  Melbourne.  Ultimately,  Capital  Projects  Division  (CAPROJ) 
in  Support  Command  is  responsible  for  conducting  RLA. 

Chief  of  Air  Staff 
(CAS) 


Air  Officer  Commanding 
Support  Command 
(AOCSC) 

l 

Capital  Projects  Division 
(CAPROJ) 

Figure  1.  RAAF  Organizations  responsible  for  RLA 

Historically,  the  RAAF  has  purchased  existing  weapon 
systems  that  have  been  operated  for  several  years  by  overseas 


Assistant  Chief 
Air  Staff 
Engineering 

(ACAS-ENG) 


Directorate  of 
Maintenance  Planning 
Air  Force 
(DMP-AF) 
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Services  such  as  the  USAF  and  United  States  Navy  (USN) . 
Accordingly,  the  RAAF  has  been  I imited  to  evaluating  repair 
level  decisions  previously  establ ished  by  those  Services,  or 
their  contractors,  and  then  modifying  them  to  al ign  with  RAAF 
support  and  organizational  requirements  (7:703) .  This 
approach  has  both  constrained  and  assisted  the  RAAF.  The 
RAAF  has  been  constrained  because  the  existing  weapon  system 
ma  i  ntenance  manua Is,  spares  availability  and  support 
structures  are  consistent  with  the  overseas  Service 
philosophy  and  not  necessarily  with  the  RAAF.  The  RAAF  has 
been  assisted  because  information  is  already  ava i I ab I e  on  the 
cost  effectiveness  of  repair  levels  establ  ished  by  the 
overseas  Service  (18:2134). 

Guidance  on  RAAF  RLA  procedures,  including  the  use  of 
foreign  source  data  is  given  in  RAAF  Headquarters  Support 
Command  Logistic  Instructions.  The  instructions  identify 
specific  cost  elements  to  be  considered  in  RAAF  RLA 
including:  training,  ground  support  equipment,  and  inventory 
costs  ( 1 8 : 2 1 3E 1 ) . 

However,  RAAF  RLA  analysts  involved  in  recent  ana  I yses 
found  that  instructions  on  how  to  calculate  specific  cost 
elements  were  too  broad.  This  meant  that  interpretations  and 
costs  varied  widely  between  analysts  (19:1,  20).  In  other 

words,  the  RAAF  has  no  standardized  quantitative  means 
whereby  RLA  cost  data  are  analyzed. 
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In  addition  to  the  cost  factors,  po  I  itical  and  strategic 
constraints  on  RLA  decisions  in  Austral ia  are  different  than 
those  used  by  other  Services.  For  instance,  the  RAAF  has  a 
po I  icy  of  developing  a  system  of  support  to  optimize  in- 
countrymaintenance  capabilities  up  to  the  depot  level  (9:1). 
This  is  necessary  because  of  the  remoteness  of  Austral ia  from 
overseas  design  and  manu f ac tur i ng  centers. 

The  RLA  performed  by  the  RAAF  may  differ  from  previous 
analyses  performed  by  other  Services  due  to  strategic 
reasons.  In  this  way  an  item  that  may  have  been  classified 
as  "throwaway'’  by  the  USAF  because  of  ease  of  replacement 
from  an  in-country  manu f ac tur er ,  may  be  specified  as 
repairable  by  the  RAAF  so  that  "...  repair  and  maintenance 
ski  I  Is  can  be  developed  or  maintained  by  the  RAAF  or  in 
Austral  i  an  industry"  (18:21310)  . 

DMP-AF  and  CAPROJ  both  have  expressed  concern  about  the 
way  RLA  is  currently  being  conducted  in  the  RAAF  (21 ,  5:1, 

19:1-3).  At  present  RLA  is  conducted  using  a  broad  set  of 
procedures  developed  in  1981.  These  procedures  suggest 
strategic  considerations  for  RLA.  However,  as  mentioned 
earlier,  while  the  econom ic  factors  to  be  considered  have 
been  provided,  the  individual  repair  level  analyst  must  use 
personal  judgement  to  select  weights  and  values  for  cost 
factors  when  performing  the  RLA  calculations. 
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Present  methods  of  RAAF  RLA  for  complex  equipment  or  sub 
systems  have  been  described  as  a  mixture  of  engineering 
judgement  and  black  magic  (17:1).  A  more  scientific  approach 
to  RLA  is  required  to  reduce  the  RAAF’s  rel iance  on  the 
individual  analysts  experience  (5:1).  Add itionaily,  existing 
RAAF  RLA  procedures  do  not  at  low  for  indenture,  that  is  the 
relationship  and  interaction  of  repair  decisions  for  SRUs  and 
LRUs  (5:1). 

In  an  effort  to  make  RAAF  RLA  procedures  more 
quantitative,  DMP-AF  initiated  an  investigation  into  the 
feasibility  of  using  the  USAF  Ne  twor  k  Repair  Level  Analysis 
(NRLA)  model  to  perform  RAAF  RLA.  The  USAF  NRLA  inode  I  is  a 
comprehensive,  computerized,  RLA  model  that  provides  for  the 
systematic  analysis  and  calculation  of  alternative  repair 
level  costs . 

The  DMP-AF  investigation  concerned  two  areas,  the 
general  suitability  of  NRLA  to  the  RAAF  env i ronmen t ,  and  the 
suitability  of  existing  RAAF  ma intenance  and  supply  databases 
to  meet  NRLA  input  requirements  (20:1,  1:2).  The  latter  area 

is  currently  being  investigated  by  Computer  Services  Division 
in  Canberra.  The  former  area  was  the  impetus  for  this 
thes i s . 

The  Pr  ob I em 

The  USAF  NRLA  model  was  perceived  by  DMP-AF  as  an 
approach  that  may  provide  a  more  scientific  means  of  Repair 
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Level  Analysis  (20:1).  However,  there  has  been  no  formal 


investigation  of  what  improvements  NRLA  offers  over  existing 
RAAF  RLA  methods.  Furthermore,  NRLA  was  designed  for  use  in 
the  USAF  environment,  to  compl iment  other  USAF  maintenance 
procedures  and  databases,  and  no  compatibi I i ty  studies  of 
NRLA  in  the  RAAF  environment  have  been  performed. 

Therefore,  an  investigation  of  NRLA’s  potential  benefits 
and  comp a  t ibility  with  existing  RAAF  RLA  me  L  hods  was 
required.  The  intent  of  this  study  was  to  determine  if  the 
NRLA  approach  offered  any  improvement  over  existing  RAAF 
procedures  and  if  NRLA  was  compatible  with  existing  RAAF 
maintenance  procedures  and  data  sources. 

Research  Objective 

The  objective  of  this  research  was  to  evaluate  the 
suitability  of  the  USAF  Network  Repair  Level  Analysis  mode  I 
as  the  primary  Repair  Level  Analysis  tool  for  the  Royal 
Austral  i  an  Air  Force. 

Research  Questions 

To  accomp I i sh  the  research  objective  three  research 
questions  were  addressed: 

Research  Question  1 .  How  does  the  RAAF  perform  Repair 
Level  Analysis?  This  was  determined  by  answer i ng  the  more 
specific  investigative  questions: 

la.  What  is  the  RAAF  po I  icy  on  RLA?;  and 
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1b.  How  is  the  RAAF  conducting  RLA  in  practice? 

Research  Question  2.  How  does  the  USAF  perform  RLA 
using  the  NRLA  model?  This  was  determined  by  addressing  the 
investigative  questions: 

2a.  What  is  the  USAF  po I  icy  on  RLA?;  and 
2b.  How  does  the  USAF  use  NRLA  in  practice9 
Research  Question  3.  Should  the  RAAF  use  NRLA  to 
perform  RLA?  This  was  determined  by  answering  the 
investigative  questions: 

3a.  What  is  not  being  done  that  should  be  done  in  RAAF 
RLA?; 

3b.  Does  NRLA  based  RLA  offer  any  improvement  over 
existing  RAAF  RLA  procedures?;  and 

3b.  Is  the  data  required  for  a  NRLA  based  RLA  ava i  I  ab  I  e 
from  existing  RAAF  data  sources? 

Limitations 

The  USAF  conducts  both  design  oriented  and  provision 
oriented  RLA.  The  USAF  describes  design  oriented  RLA  as  part 
of  "...  a  goal  to  evolve  a  design  that  considers  the 
economics  of  support,  stating  alternatives  and  producing  an 
econom ical  life  cycle  cost  profile"  (14:1).  Provision 
oriented  RLA  occurs  after  the  initial  design  process. 

Only  in  very  rare  cases  is  an  aircraft  developed  in 
Australia  to  a  RAAF  specification  (7:702).  Consequently, 
there  is  I  ittle  need  to  consider  that  part  of  the  USAF 
procedures  dealing  with  design  oriented  RLA .  The  existing 
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RAAF  RLA  procedures  deal  with  provision  oriented  RlA  and  this 
is  the  ma in  concern  of  DMP-AF  and  CAPROJ  staff  (5:1,1 : 2 ) . 
Therefore,  this  research  was  confined  to  the  use  of  NRLA  in 
USAF  provision  oriented  RLA  and  its  app I ication  to  the  RAAF. 

The  number  of  RAAF  personnel  involved  in  both  the  po I  icy 
and  implementation  of  RLA  number  less  then  ten,  and  they  deal 
with  only  one  or  two  major  analyses  a  year.  Therefore,  there 
was  no  opportunity  to  do  large  surveys  or  look  at  large 
numbers  of  repair  level  analyses  completed  by  different 
teams . 

The  research  was  I imited  to  discussing  RLA  matters  with 
individuals  through  telephone  interviews,  and  va I idating  the 
responses  of  those  conduct  1 ng  RLA  in  CAPPROJ  with  the  po I  icy 
makers  in  DMP-AF. 

The  last  investigative  question  required  that  the 
availability  of  data  for  NRLA  based  RAAF  RLA  be  investigated. 
This  was  limited  to  identifying  the  par  ame  ters  required  for 
NRLA  and  poss i b I e  sources  of  data.  The  mechanics  of 
extracting  information  from  the  database  and  modifying  it  for 
input  to  NRLA  will  not  be  addressed  as  it  is  the  subject  of  a 
separate  investigation  by  DMP-AF. 

Benefits  of  Research 

This  research  documents  existing  RAAF  and  USAF  RLA 
procedures,  identifies  drawbacks  of  the  present  method  of 
RAAF  RLA,  establ ishes  the  improvements  offered  by  NRLA  over 


existing  RAAF  RLA  methods,  and  identifies  possible  sources  of 
data  for  both  existing  and  NRLA  based  RAAF  RLA. 

The  study  shows  that  NRLA  is  appl icable  to  the  RAAF  RLA 
env i ronment  in  a  limited  capacity,  provided  reliable  data  can 
be  obtained  for  the  NRLA  model .  NRLA  is  shown  to  offer 
advantages  in  the  al location  of  support  equipment  costs 
between  multi  use  components,  and  the  conduct  of  sensitivity 
ana  lysis. 

In  addition,  because  present  RAAF  RLA  methods  and  their 
deficiencies  have  been  we  I  I  documented,  this  research 
provides  a  firm  basis  for  further  studies  into  alternative 
RLA  procedures  for  the  RAAF. 

Summary 

Repair  Level  Analysis  is  the  process  of  analyzing  the 
economics  of  repair  and  the  economic  al location  of 
maintenance  workload  between  available  service  and  contractor 
ma intenance  facilities  (18:1108). 

Several  perceived  drawbacks  of  existing  methods  of  RAAF 
RLA  have  been  identified: 

a.  the  lack  of  specific  instructions  on  calculating 

cost  el emen  ts , 

b.  the  lack  of  a  professional  and  scientific  approach 

which  means  that  the  outcome  of  an  analysis  depends 


heavi ly  on  the  individual  performing  the  analysis,  and 


c.  that  no  al low ance  is  made  for  indentured 
relationships  between  LRUs  and  SRUs  in  RLA 
ca I cu I  a  t i ons . 

RAAF  management  has  suggested  that  the  USAF  NRLA  based 
approach  to  RLA  could  be  used  by  the  RAAF  to  overcome  these 
three  drawbacks.  However,  no  objective  study  had  been 
previously  per  formed  to  document  the  benefits  nor  critically 
analyze  the  value  of  NRLA  to  the  RAAF. 

The  objective  of  this  research  was  to  evaluate  the 
su i tab i  I  i ty  of  the  USAF  NRLA  mode  I  as  the  pr  imary  Repa  i  r 
Level  Analysis  tool  for  the  Royal  Austral i an  Air  Force. 

Thesis  Organization 

The  remainder  of  this  thesis  reviews  the  USAF  NRLA  and 
RAAF  RLA  procedures  and  documents  the  study’s  methodology  and 
data  analysis.  Chapter  II  contains  an  explanation  of  USAF 
and  RAAF  RLA  procedures.  The  various  USAF  RLA  techniques  are 
described,  and  specific  details  are  provided  on  the 
assumptions  and  input  requirements  of  the  NRLA  model .  The 
mechanics  of  RAAF  RLA  techniques  and  sources  of  RLA  data  are 
a  I  so  descr i bed . 

Chapter  I  I  I  explains  the  methodology  used  in  this 
research.  The  methodology  includes  a  review  of  USAF  and  RAAF 
RLA  procedures,  a  comparison  of  the  procedures  to  highl  ight 
any  similarities  and  differences,  and  the  procedure  for 
interviewing  the  RAAF  RLA  staff  to  determine  if  the 
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advantages  suggested  by  NRLA  are  suitable  for  the  RAAF 
env i r  onmen  t . 

Comparative  analysis  of  the  RAAF  and  USAF  RLA 
procedures,  and  the  responses  of  RAAF  RLA  staff  are  included 
in  chapter  IV.  The  conclusions  and  recommendations  made  as  a 
result  of  the  study  are  contained  in  Chapter  V. 
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Literature  Review 


Over v I ew 

This  chapter  provides  a  detai led  explanation  of  USAF  and 
RAAF  RLA  procedures.  The  various  USAF  RLA  techniques  are 
described  and  specific  details  are  provided  on  the 
assumptions  and  data  input  requirements  of  the  NRLA  mode1 . 

The  mechanics  of  RAAF  RLA  techniques  and  sources  of  RLA  data 
are  also  described. 

USAF  RLA  Pol  icy 

"The  goal  of  the  [USAF]  RLA  program  is  to  establ ish 
equipment  and  component  repair  level  decisions  on  an 
economical  and  effective  basis  that  integrate  design, 
operations,  and  logistics  support  characteristics" 

(15:1). 

The  USAF  policy  on  RLA  specifies  two  RLA  programs ,  design 
oriented  RLA  and  provision  oriented  RLA  (15:1). 

Design  oriented  R  LA  is  the  preliminary  analysis  that 
begins  early  in  the  acquisition  program  and  continues  through 
critical  design  review.  Its  goal  is  to  evolve  a  design  that 
considers  the  economics  of  support  alternatives  and  produces 
an  econ om ical  life  cycle  cost  profile  (15:1).  It  identifies: 
repair  level  constraints  resulting  from  the  system 
operational  concept,  specific  design  features  that  will 
improve  reliability  and  maintainability  and  reduce  repair  and 
discard  costs,  and  previous  design  probl ems  on  similar 


systems  and  items  to  avoid  repeating  them  in  new  systems 
(15:2)  . 

Provision  oriented  RLA  begins  after  initial  system 
design  is  comp lete  (15:1).  It  involves  the  use  of  RLA  mode  I s 
to  determine  the  most  economic  levels  of  repair  for  system 
components  (15:2).  The  analysis  justifies  r  e commend  ed 
support  equipment,  spare  and  repair  parts,  technical 
documentation,  facilities,  and  maintenance  personnel 
requirements  (15:2) . 

USAF  RLA  Models/Methods 

There  are  several  methods  that  can  be  used  for  RLA  in 
the  USAF.  These  methods  are  described  in  AF  LC/AFSC  pamphlet 
800-4  and  include:  Cursory  0 i scard  Equations,  Equal  Cost 
Curves  (ECC) ,  Support  Equ i pment/P i pe I  me  Ratios,  Marginal 
Analysis  Repair  Level  Analysis  (MARLA),  I  tern  Repair  Level 
Analysis  (  I  R  LA )  ,  and  Ne  two  rk.  Repair  Level  Analysis  (NRLA) 
(14:1). 

Cursory  Discard  Equations,  Equal  Cost  Curves  and  Support 
Equipment/  P i pe I i ne  Ratios  methods  are  screening  procedures. 
They  can  be  useful  in  determining  initial  repair  versus 
discard  decisions  without  the  detailed  analysis  required  by 
I R  LA ,  MRLA  or  NRLA  (14:10). 

The  Cursory  Discard  Equation  approach  determines  the 
replacement  cost  and  minimum  support  equipment,  spares,  and 
material  cost  for  a  component.  If  the  replacement  cost  is 
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less  than  the  minimum  combined  cost  of  spares,  support 
equ i pmen  t  and  other  mater i a  I  ,  then  a  discard  on  failure 
po I  icy  should  be  adopted  (14:9)  . 

If  the  initial  assessment  is  for  repair,  and  support 
equipment  costs  can  be  aggregated  between  a  family  of  items, 
tnen  an  Equal  Cost  Curves  approach  can  be  used  (14:9) .  Equal 
Cost  Curves  are  based  on  historical  information  on  the  same 
or  similar  components. 

Costs  equations  are  developed  for  discard,  depot,  and 
intermediate  repair  alternatives  in  terms  of  var lables  such 
as  cost  per  unit  and  expected  repairs  per  month.  The 
equations  are  set  equal  to  each  other  and  parameters  are 
varied  to  develop  a  locus  of  points  for  d  .scarcl  equals 
intermediate,  discard  equals  depot  and  intermediate  equals 
depot  repair  costs.  An  example  of  a  set  of  equal  cost  curves 
is  shown  at  Figure  2.  Plotting  the  estimated  unit  cost  for  a 
new  component  against  the  expected  repairs  per  month  for  that 
component  will  give  a  point  on  the  graph.  The  region  that 
point  falls  into  will  specify  the  mos  t  eco  nom i ca I  repair 
po I  icy  for  the  component. 

The  final  screening  procedure  that  can  be  used  is  the 
Suppor t  Equ i pment/P i pe I i ne  Ratio  procedure.  This  procedure 
compares  the  investment  in  establ  ishing  a  depot  repair 
p i pe I i ne  and  the  cost  of  the  required  Support  Equipment  at 
intermediate  level  if  items  are  not  sent  to  the  depot.  If 


Cost/Unit 


A  select  Discard 

B  select  Intermediate  repair 

C  select  Depot  repair 

Figure  2.  Equal  Cost  Curves  (adapted  from  14:10) 

the  p i pe I i ne  cost  is  significantly  less  than  the  cost  of  the 
additional  intermediate  support  equipment^  than  intermediate 
repair  can  be  eliminated  as  an  option  in  any  further 
analysis.  If  the  reverse  is  true,  *:  h  e  n  depot  repair  can  be 
el iminated  from  any  further  analysis  (14:9) . 

A  diagram  of  the  screening  process  is  shown  in  Figure  3. 
If  screening  procedures  cannot  be  appl i ed ,  or  they  produce 
inconclusive  results,  mor  e  detailed  analysis  involving  MRLA, 


IRLA,  or  NRLA  is  required. 


Figure  3.  USAF  RLA  Screening  Process  (adapted  from  14:7-11) 


Marginal  Analysis  Repair  Level  Analysis  (MARLA)  is  a 
means  of  making  repair  level  decisions  using  marginal  cost 
analysis  to  select  repair  levels  (14:14).  In  MARLA  costs  are 
classified  as  either  p  i  pe I  ine  costs  or  support  equipment 
costs.  Repair  level  decisions  are  made  on  the  basis  of  scrap 
costs  versus  p i pe I ine  costs  plus  support  equipment  costs 
(14:14).  Decisions  are  made  according  to  the  foil ow i ng 
cr i ter i a : 
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where : 

Ps  is  the  scrap  cost. 

Pi  is  the  intermediate  repair  p  i  pe I  ine  cost. 

Pd  is  the  depot  repair  p i pe I ine  cost. 

SE i  is  the  intermediate  support  equipment  cost. 

SEd  is  the  depot  support  equipment  cost. 

If  criterion  (3)  is  satisfied,  then  intermediate  repair 
should  be  chosen  because  the  support  equipment  and  pipe! ine 
costs  for  that  alternative  are  less  then  the  depot  p i pe I ine 
costs  or  discard  on  failure  costs.  If  criterion  (4)  is 
satisfied,  depot  repair  should  be  chosen  because  the  costs 
for  that  alternative  are  less  then  the  intermediate  p i pe I  ine 
or  discard  costs.  The  discard  alternative  should  be  chosen 
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if  criterion  (5)  is  met,  where  cost  of  discard  is  less  then 
the  depot  or  intermediate  p i pe I  i  ne  costs. 

MARLA  is  similar  to  the  Support  Equipment/Pipeline 
approach  with  the  exception  that  the  various  costs  are 
i nvest i gated  mor e  fully  to  substantiate  final  decisions. 

MARLA  does  not  consider  indenture,  that  is  the 
relationship  and  interaction  between  LRUs  and  SRUs ,  when 
al locating  support  equipment  costs.  It  assumes  that  support 
equipment  costs  are  apportioned  equal ly  between  LRUs  and 
SRUs.  For  components  or  sub-assembl ies  where  this  assumption 
does  not  hold,  the  more  complex  IRLA  technique  should  be  used 
(14:15) . 

Intermediate  Repair  Level  Analysis  (IRLA)  accommodates 
indenture  levels.  This  requires  that  support  equipment  costs 
be  allocated  to  LRUs  and  SRUs  on  the  basis  of  actual  usage. 
After  allocating  the  support  equipment  costs,  repair  level 
decisions  can  be  made  using  the  same  reasoning  as  the  MARLA 
techn  ique . 

When  using  IRLA,  support  equipment  costs  attributable  to 
each  component  at  each  level  of  indenture  must  be  determined 
manually.  In  addition,  LRUs  and  SRUs  are  examined  on  a  "one 
at  a  time"  basis,  which  can  lead  to  contradictory  results 
(14:13).  For  example,  an  SRU  could  be  allocated  to  base 
level  repair  while  an  LRU  that  contains  it  could  be  allocated 
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to  depot  level  repair  (14:13).  The  limitations  of  IRLA  can 
be  overcome  by  using  the  NRLA  approach. 

The  Network  Repair  Level  Analysis  (NRLA)  method  is 
different  from  proration  methods  such  as  IRLA  in  that  it 
avoids  having  to  al locate  costs  to  individual  items.  In  NRLA 
the  total  cost  of  each  Support  Equipment  item  is  structural ly 
tied  to  each  LRU  and  SRU  which  requires  the  SE  (3:4) . 

In  essence,  NRLA  models  use  I i fe  cycle  costs  together 
with  LRU/SRU/SE  interdependency  relationships  to  construct  a 
network  representation  of  the  repair  level  decision  problem 
(3:1).  Using  a  computer,  the  network  representation  can  be 
solved  to  provide  a  system  wide  optimal  repair  solution 
rather  than  an  individual  component  solution,  as  is  the  case 
with  IRLA  analysis  (3:1). 

The  USAF  recommends  NRLA  as  the  preferred  method  of 
conducting  RLA  in  the  USAF  (14:12).  This  is  because  it  uses 
the  systems  approach  and  can  analyze  a  sma I  I  system  or 
subsystem  in  one  iteration.  NRLA  a  I  so  al  lows  a  variety  of 
sensitivity  analyses  to  be  performed  via  simple  instructions 
from  the  analyst. 

However,  in  practice  NRLA  is  only  used  for  components 
and  sub-assembl ies  which  possess  a  complex  relationship 
between  SRUs  and  LRUs.  This  is  to  prevent  the  unnecessary 
use  of  computer  and  data  col  lection  time  on  components  that 
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could  be  accurately  analyzed  using  the  simpler  RLA  techniques 
described  above  (22) . 

Detailed  NRLA  Procedures 

The  USAF  NRLA  model  is  a  FORTRAN  based  computer  program 
that  compares  the  cost  of  depot,  intermediate,  and  discard 
repair  level  decisions.  NRLA  was  developed  on  the  Honeywe I  I 
635  computer;  however ,  it  has  been  successful ly  run  on  IBM 
hardware  (2:1,  22).  The  mode  1  makes  several  assumpt ions 
including: 

a.  If  one  base  sends  a  particular  LRU  or  SRU  to  a  depot 
for  repair,  then  al I  bases  send  their  repairables  of 
that  item  to  the  same  depot  for  repair.  in  other  words, 
in  the  logistics  system  being  modeled  there  is  only  one 
depot  (3:2); 

b.  Base  level  maintenance  data  such  as  ava i I ab I e  work 
time  per  man,  labor  rate,  and  turn  over  rate  are  equal 
for  al I  bases  for  and  al I  types  of  repair  (3:3) ; 

c.  Supply  system  data  is  constant  for  al I  SRUs  and  LRUs 
being  analyzed.  This  means  that  order  and  shipping  time 
from  depot  to  each  base  is  a  constant  for  every  item 
(3:3)  ; 

d.  Only  one  set  of  technical  data  is  purchased  from  the 
contractor,  and  dupl ication  and  distribution  costs  for 
additional  sets  of  data  are  minor  and  assumed  to  be  zero 
(3:3)  ; 


23 


e.  The  model  expl icitly  evaluates  each  type  of  LRU 
failure,  however,  SRUs  are  evaluated  only  in  terms  of 
the  support  equi pmen  t,  repair  skills  and  repair  ti  me 
required  for  their  principle  mode  of  failure  (3:3);  and 

f.  Depot  level  stocks  of  SRUs  are  computed  on  the  basis 
of  base  level  demands  for  SRUs,  that  is,  to  resupply 
bases  when  they  send  SRUs  to  the  depot  for  repair. 
Therefore,  the  SRU  calculations  support  a  base  remove 
and  replace  actions  but  not  depot  remove  and  replace 
actions  (3:3). 

The  NRLA  computer  program  uses  two  types  of  data  input 
files.  One  file  contains  run  specific  in  format i on  wh i  I e  the 
other  contains  program  specific  information  which  is  uni i ke l y 
to  change  from  run  to  run  (3:5).  The  NRLA  run  specific  input 
data  file  contains  information  on  the  format  of  the  output 
data  and  the  type  of  sensitivity  analysis  required  (3:30-35). 

The  program  specific  file  contains  records  of 
information  on  weapons  system  data  and  options,  maintenance 
system  data,  supply  system  data,  support  equipment  data,  LRU 
description,  LRU  failure  modes,  SRU  data,  and  Support 
Equipment  resource  data.  Appendix  A  contains  details  of  the 
specific  entries  made  in  each  of  these  data  records. 

Output  from  the  NRLA  model  may  contain  any  of  the 
foil ow i ng :  a  summar  y  of  input  data,  alternative  repair  costs 
for  LRUs  and  SRUs,  recommended  repair  levels  for  LRUs  and 
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SRUs,  the  expected  cost  of  support  equipment  at  intermediate 
and  depot  level  for  the  system  being  analyzed,  and  any 
sensitivity  analysis  results  (3:43).  NR LA  a  I  I ows  sensitivity 
analysis  to  be  performed  by  varying  LRU  costs,  LRU  Mean  Time 
Between  Failure  (MTBF) ,  or  Support  Equipment  costs  by  a  fixed 
percentage  (14:13). 

General ly,  Network  Repair  Level  Analysis  is  performed  by 
the  contractor  using  the  standard  USAF  NRLA  computer  program. 
The  components  or  sub-systems  to  be  analyzed  by  NRLA  are 
usually  specified  by  agr  eemen  t  be  tween  the  USAF  pr  ogr  am 
manager  and  the  contracting  authority  (22) . 

RAAF  Repair  Level  Analysis  Pol  icy 

Repair  Level  Analysis  is  conducted  on  behalf  of  the 
Directorate  of  Maintenance  Planning  -  Air  Force  (DMP-AF)  by 
Head  Quarters  Support  Command  (HQSC) .  However,  repair  level 
decisions  do  not  become  po I  icy  unti  I  approved  by  DMP-AF. 

Repair  level  po I  icies  are  issued  as  part  of  the 
Technical  Maintenance  Plan  (TMP) .  Each  aircraft  type  and 
major  equipment  system  in  the  RAAF  has  a  TMP.  The  TMP  is 
issued  by  DMP-AF  and  specifies  maintenance  policy  for  all 
ma i ntenance  managed  i terns  of  the  parent  equi pmen  t  (11:1). 

DMP-AF  provides  directions  on  general  RLA  principles 
rather  than  specifying  particular  models  or  mechanisms  to  be 
employed  in  performing  a  RLA.  This  al lows  HQSC  considerable 
latitude  in  the  way  it  conducts  RLA.  Even  so,  DMP-AF  still 
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maintains  control  over  the  RLA  process  in  its  role  as  the 
approving  authority  for  any  final  repair  level  decisions. 

DMP-AF  specifies  that  RLA  procedures  are  to  involve  a 
cost  benefit  analysis  (7:407).  The  analysis  should  include 
facilities,  spares  i terns ,  support  equi pment ,  training, 
manpower,  spares  consumption,  and  shipping  and  hand  I  i ng  costs 
(7 : 407)  . 

The  use  of  data  from  USAF  NRLA  and  USN  M I L-STD- 1 390B 
based  RLA  is  permitted  in  RAAF  RLA,  provided  the  data  is 
consistent  with  RAAF  organizational  and  support  r equ i r emen ts , 
and  RAAF  experience  with  similar  i terns  under  similar 
operating  conditions  (7:703). 

RLA  po I  icy  also  requires  the  analyst  to  state  the  range 
of  circumstances  for  which  a  particular  analysis  is  va I  id. 
This  is  necessary  to  ensure  that  long  term  support 
requirements  and  operational  f I  ex i b i  I  i ty  factors  are 
considered  in  any  calculations  (7:407). 

The  broad  po I  icy  guidel  i nes  on  RLA  provided  by  OMP-AF 
have  been  interpreted  in  HQSC  Logistics  Branch  Instructions. 
In  addition  to  po I  icy  i  n t e r pr e t a t i ons ,  procedures  for  the 
conduct  of  RLA  are  also  included. 

HQSC  recognizes  that  RLA  on  a  par t i cu I ar  aircraft  or 
major  equipment  type  is  often  performed  by  foreign  services 
and  contractors  before  the  item  is  procured  by  the  RAAF 
(18:1019). 


26 


The  major  benefit  of  using  foreign  souroe  data  in  RLA 
analysis  is  that  information  on  maintenance  publ  ications, 
support  equipment  requirements,  and  spares  requirements  are 
likely  to  be  available  (18:2134).  However ,  analysts  are 
warned  that  such  data  and  subsequent  repair  level  decisions 
are  consistent  with  the  foreign  service’s  maintenance 
concepts  and  resources  and  not  necessar i I y  the  RAAF ’ s 
(18:2134) . 

This  is  consistent  with  the  DMP-AF  policy  on  allowing 
the  use  of  foreign  source  data  provided  it  is  modified  to 
suit  the  RAAF  env i ronment  (7:703) . 

RAAF  RLA  Methods 

Capital  projects  Division  (CAPPROJ)  within  HQSC  is 
responsible  for  conducting  RLA  in  the  RAAF.  A  flowchart  of 
the  RAAF  RLA  procedure  used  by  CAPPROJ  staff  is  shown  in 
Figure  4.  The  procedure  begins  with  a  screening  process  that 
is  limited  to  determining  if  a  componen  t  is  intrinsically 
repairable  (18:2132).  If  it  is  not  possible  for  a  component 
to  be  repaired,  the  only  repair  po I  icy  that  can  be  adopted  is 
one  of  discard  on  failure.  However ,  i  f  a  componen  t  can  be 
repaired,  current  procedures  cal  I  for  a  complete  repair 
analysis  to  be  conducted. 

The  first  stage  in  a  complete  repair  analysis  involves 
gathering  data  on  fourteen  cost  elements  to  be  considered  in 
repair  level  calculations.  Initial  or  non  recurring  costs 


and  f o I  low  on  or  recurring  costs  are  calculated  for  each  of 
these  el emen  ts  (18:1322).  A  list  of  these  cost  el  erne n  ts  is 
shown  in  Appendix  B.  The  appendix  also  includes  the  factors 
to  be  considered  when  calculating  initial  and  fol low  on 
costs.  For  example,  when  considering  the  cost  element  of 
maintenance  publ  ications,  initial  costs  would  include: 
selection,  val idation,  purchasing,  cataloguing  and  manpower 
set  up  costs.  Fol low  on  costs  would  include  configuration 
change  and  publ  ication  management  manpower  costs. 

If  there  is  insufficient  data  available  to  determine  the 
value  of  a  cost  element,  the  matter  is  referred  to  DMP-AF. 
DMP-AF  may  authorize  the  removal  of  the  element  from  R LA 
considerations,  or,  in  conjunction  with  CAPPROJ  personnel, 
determine  an  arbitrary  value  for  the  cost  element  (18:2132)  . 
The  latter  option  relies  on  the  experience  of  the  individuals 
involved  in  the  analysis  (4)  . 

The  cost  element  data  is  analyzed  using  a  cost 
comparison  chart,  which  is  shown  in  Appendix  C.  Each  of  the 
cost  elements  is  I isted  together  with  the  recurring  and  non 
recurring  costs  for  alternative  ma intenance  pol icies. 
Individual  costs  are  then  summed  to  give  total  I ife  cycle 
costs  for  each  alternative. 

On  the  basis  of  life  cycle  costs  a  draft  repair  pol icy 
is  chosen  by  CAPPROJ  staff.  DMP-AF  and  CAPPROJ  then  review 
the  policy  and,  if  necessary,  modify  it  to  reflect  strategic 
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cons iderat i ons . 


The  justification  of  a  final  repair  po I  icy 


is  documented  on  a  CAPPROJ  RLA  record  proforma,  which  is 
shown  at  Appendix  D. 

The  CAPPROJ  approach  to  RLA  is  consistent  with  DMP-AF 
po I  icy  in  that  a  range  of  costs  is  identified,  a  common 
base  I  i ne  is  used,  the  c i r cums tances  for  which  the  analysis  is 
va I  id  is  identified,  and  factors  such  as  long  term  support 
r equ i r  emen  ts  and  operational  flexibility  are  included. 

The  main  tool  used  in  support  of  the  RLA  process  is  the 
RAAF  Procurement  and  Provisioning  model  (PATRIC) .  PATRIC 
al lows  spares  requirements  to  be  calculated  tor  a  given  mean 
t i me  be  tween  failure,  rate  of  effort,  and  resupply  pipeline. 

It  provides  useful  information  on  the  cost  of  spares  support 
for  the  various  levels  of  maintenance. 

Another  source  of  data  that  is  useful ,  provided  simi I ar 
items  are  already  in  service,  is  the  RAAF  Maintenance 
Analysis  and  Reporting  System  (MAARS) .  MAARS  can  provide 
actual  rel i ab i I ity,  maintenance,  and  general  logistics  system 
data  on  components  already  in  the  RAAF  maintenance  system 
(6:3) .  In  terms  of  the  cost  elements  to  be  considered  in 
RLA,  this  MAARS  information  is  useful  for  calculating 
real istic  maintenance  manpower,  spares,  support  equipment, 
t r anspor ta t i on ,  packaging  and  hand  I  i ng  costs. 

Present  RAAF  RLA  methods  involve  manual  procedures  and 
are  based  on  the  principles  of  marginal  cost  analysis  (5:1). 
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W hi le  this  appears  to  be  adequate  for  simple  components, 
problems  arise  when  analyses  relate  to  components  with 
complex  LRU/SRU/SE  relationships. 

The  existing  RAAF  approach  does  not  al low  for  indenture. 
RAAF  procedures  apportion  Ground  Support  Equipment  (GSE) 
costs  equal ly  against  al I  LRUs  that  use  the  GSE,  rather  than 
basing  costs  on  GSE  utilization  rates  (5:1).  Additionally, 
because  of  the  manual  approach  to  RLA,  it  would  be  difficult 
and  time  consuming  to  perform  sensitivity  analysis  on  RLA 
calculations. 

Summary 

The  USAF  RLA  process  consists  of  both  screening 
procedures  and  detailed  analysis  procedures.  The  screening 
procedures  use  simple  algorithms  to  make  ''obvious''  reoa  i  r 
level  decisions  for  some  system  components.  However,  if  the 
constraints  of  these  procedures  cannot  be  met,  more  detai  led 
analysis  is  required. 

In  MARLA,  costs  are  a' located  as  either  repair  or 
pipeline  costs  and  repair  decisions  are  made  by  compar i ng  the 
cost  to  discard  to  the  sum  of  p  i  pe I  i ne  and  support  costs. 

I  R  LA  is  similar  to  MARLA ;  howe  ver,  indentured  relationship  ■_> 
between  LRUs  and  SRUs  are  acknowledged  and  the  cost  of 
support  equipment  is  al located  on  the  basis  of  actual  use. 

NRLA  is  the  most  complex  method  of  RLA,  it  uses  a 


system^  approach  and  possesses  the  capac  i  ty  to  analyze  a 


sma I  I  system  or  subsystem  in  one  iteration.  NRLA  al  lows  the 
relationships  between  SRU’s  and  LRU’s  to  be  modeled  as  a 
network.  Support  equipment  costs  are  automatical ly 
attributed  to  SRUs  and  LRUs  by  NRLA  on  the  basis  of 
LRU/SRU/SE  interdependency.  Sensitivity  analysis  and  changes 
to  input  data  can  be  accommodated  in  NRLA  by  changing  one  or 
two  data  cards . 

The  CAPPROJ  approach  to  RLA  is  consistent  with  DMP-AF 
policy  in  that  a  range  of  cost  el emen  ts  are  identified,  the 
c i r cumstances  for  which  an  analysis  is  va I  id  is  recorded,  and 
strategic  constraints  are  considered  in  final  po I  icy 
del  i  ber at i ons . 

The  screening  procedure  in  RAAF  RLA  is  I imi ted  to 
determining  if  an  it  em  is  intrinsically  repairable.  If  a 
component  is  deemed  repairable  a  standard  form  of  marginal 
cost  analysis  is  per f ormed ,  regardless  of  the  complexity  of 
the  component  being  analyzed. 

The  marginal  analysis  approach  used  by  the  RAAF  does  not 
a  I  I ow  for  indenture  when  allocating  support  equi pmen  t  costs, 
and  for  some  cost  elements  there  is  a  heavy  re  iance  on  the 
individuals  performing  the  analysis  to  interpret  and  al locate 
cost  data.  In  addition,  because  of  the  manual  approach  to 
RAAF  RLA ,  it  wou Id  be  difficult  and  time  consuming  to  perform 
sensitivity  analysis  on  RLA  calculations. 
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Me  thodo logy 


Over  v i ew 

The  purpose  of  this  research  was  to  evaluate  the 
suitability  of  the  USAF  Ne  twork  Repair  Level  Analysis  (NR LA) 
model  as  the  pr imary  Repair  Level  Analysis  tool  for  the  Royal 
Austral i an  Air  Force  (RAAF) .  To  achieve  this  objective  the 
research  was  conducted  in  three  phases. 

In  phase  1  of  the  research  background  material  on  RAAF 
and  USAF  RLA  procedures  were  gathered.  This  was  necessary  to 
determine  the  context  in  which  NRLA  was  used  in  USAF  RLA,  and 
provide  background  for  subsequent  studies  on  the  impact  of 
NRLA  on  RAAF  RLA  procedures. 

There  has  been  no  formal  research  on  RAAF  and  USAF  RLA 
procedures.  Consequently,  the  primary  sources  of  information 
on  the  subject  were  RAAF  and  USAF  orders,  regulations, 
instructions,  and  pamphlets.  Supplementary  information  was 
obtained  through  formal  and  informal  interviews  with  RAAF 
analysts  in  DMP- AF  and  CAPPROJ,  and  USAF  analysts  at  Wright- 
Patterson  AFB ,  Ohio 

In  phase  2  of  the  research  drawbacks  of  existing  RAAF 
R  LA  me  t  hods  we  re  identified.  The  dr  awbac  ks  we  re  determined 
by  reviewing  critiques  by  analysts  i nvo I ved  in  recent  RLA 
programs,  as  we  I  I  as  formal  interviews  with  RAAF  RLA 
pr ac t  i  t i oner s  and  do  I  icy  makers  in  DMP-AF  and  CAPPROJ. 
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In  phase  3  of  the  research  the  suitability  of  USAF  NR LA 


for  RAAF  RLA  was  evaluated.  The  strengths  and  weaknesses  of 
NRLA  and  its  use  by  the  USAF  were  reviewed  to  determine  if 
NRLA  could  be  used  to  overcome  the  drawbacks  of  existing  RAAF 
RLA  procedures. 

In  the  remainder  of  this  chapter  the  specific  aspects  of 
the  three  research  phases  are  discussed.  First,  the  research 
questions  identified  in  chapter  I  are  restated.  The 
relationship  between  each  phase  of  research  and  the  research 
questions  is  then  described.  Finally,  the  limitations,  pre¬ 
testing  and  conduct  of  the  formal  interviews  for  this 
research  are  explained. 


>ec  i  f  i  c  Methodo  I  o< 


To  accompl i sh  the  research  objective  three  research 


questions  were  developed.  More  specific  investigative 
questions  were  generated  for  each  of  the  research  questions. 
By  answering  the  investigative  questions  information  to 
answer  the  higher  order  research  questions  was  obtained.  The 
three  research  questions  and  their  associated  investigative 
questions  were: 


1  .  How  does  the  RAAF  perform  Repair  Level  Analysis  ^ 

la.  What  is  the  RAAF  po I  icy  on  RLA? 

lb.  How  is  the  RAAF  conducting  RLA  in  practice? 

2.  How  does  the  USAF  perform  RLA  using  the  NRLA  mode  I  7 
2a.  What  is  the  USAF  po I  icy  on  RLA’ 


2b  . 


How  does  the  USAF  use  NRLA  in  practice5 

3.  Should  the  RAAF  use  NRLA  to  perform  RLA? 

3a.  What  is  not  being  done  that  should  be  done  in 
RAAF  RLA? 

3b.  Does  NRLA  based  RLA  offer  any  improvement  over 
existing  RAAF  RLA  procedures? 

3b.  Is  the  data  required  for  a  NRLA  based  RLA 
ava i I ab I e  from  existing  RAAF  sources? 

Research  questions  1  and  2  were  addressed  in  phase  I  of 
the  research  effort.  Phase  2  of  the  research  addressed 
investigative  question  3a.  Phase  3  of  the  research  effort 
addressed  investigative  questions  3b  and  3c.  The  specific 
methodology  used  to  answer  each  of  the  research  questions 
will  be  discussed  next. 

Research  Question  1 .  How  does  the  RAAF  perform  Repair 

Leve I  Ana  lysis? 

The  RAAF  po I  icy  on  RLA  was  determined  by  reviewing 
Defence  Technical  Instructions  on  the  matter,  and  obtaining 
supplementary  information  through  informal  interviews  with 
RLA  po I  icy  makers  in  the  Directorate  of  Maintenance  Planning 
(DMP-AF) ,  Headquarters  -  Austral ian  Defence  Force. 

How  the  RAAF  conducts  RLA  in  practice  was  determined  by 
reviewing  work  sheets  and  written  procedures  used  in  recent 
RLA  app I  ications.  Formal  interviews  with  RLA  pr ac t  i  t  i  one r s 
were  also  performed.  The  review  concentrated  on  the  analysis 
of  BlackHawk  aircraft  components  as  that  was  the  most  recent, 
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and  therefore  most  current  example  of  how  the  RAAF  conducts 
RLA . 

Research  Question  2.  How  does  the  USAF  perform  Repair 
Level  Analysis  using  the  NRLA  model? 

Answer ing  this  question  involved  a  similar  me  thodo I ogy 

to  that  used  for  research  question  1.  USAF  RLA  po I  icy  was 

determined  through  a  review  of  Air  Force  Logistic  Command 

(AFLC)  and  Air  Force  Systems  Command  (AFSC)  Pamphlets  and 

instructions  on  the  matter. 

The  use  of  NRLA  in  practice  was  determined  through  a 

review  of  NRLA  handbooks  and  manuals,  and  examples  of  NRLA 

based  analysis.  Supplementary  information  on  the  mechanics 

of  NRLA  was  obtained  through  informal  interviews  with  the 

chief  NRLA  analyst  in  AFLC  at  Wr i gh t-Pa t ter son  AFB ,  Ohio. 

Research  Question  3.  Should  the  RAAF  use  NRLA  to 
perform  Repair  Level  Analysis? 

The  first  step  in  answering  this  question  involved 

determining  the  drawbacks  of  the  present  RAAF  RLA  methods. 

The  background  material  presented  in  chapter  I  and  the  review 

of  RAAF  and  USAF  RLA  procedures  presented  in  chapter  I  I 

showed  that  the  perceived  drawbacks  of  RAAF  RLA  include: 

a.  the  lack  of  specific  instructions  on  how  to 
calculate  cost  elements, 

b.  the  lack  of  a  professional  and  scientific  approach 
which  means  that  the  outcome  of  an  analysis  depends 
heavily  on  the  individual  performing  the  analysis,  and 
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c.  that  no  al lowance  is  made  for  indentured 
relationships  between  LRUs  and  SRUs  in  RLA 
calculations. 

d  .  that  any  1  >•  m  •  •  f  sen'j  :  "  v  >  i  /  analysis  requ  ires  a 

complete  rework  of  the  RLA  process. 

To  further  investigate  these  perceived  drawbacks  of 
existing  RAAF  RLA  methods,  RLA  po I  icy  makers  and  RLA 
pr ac t i t i oner s  were  interviewed.  The  interview  process  is 
explained  fu I ly  in  a  separate  section  later  in  this  chapter. 

After  the  drawbacks  of  RAAF  RLA  were  confirmed  and 
documented,  NRLA  based  RLA  procedures  were  investigated  to 
determine  if  they  could  offer  any  improvements  over  existing 
methods.  For  example,  one  drawback  of  the  RAAF  system  is 
that  it  does  not  al low  for  indentured  re l at i onsh i ds  between 
SRUs  and  LRUs;  NRLA  does  provide  for  this  indenture. 

The  researcher  found  that  NRLA  did  offer  advantages 
over  existing  RAAF  methods  of  RLA.  Therefore,  the  next  step 
was  to  investigate  if  NRLA  data  requirements  could  be 
satisfied  from  existing  RAAF  data  sources.  This  was 
accompl i shed  by  matching  the  input  requirements  for  NRLA 
(refer  to  Appendix  A)  with  RAAF  data  availability.  The 
sources  of  RAAF  data  which  were  investigated  included  the 
Computer  Aided  Maintenance  Management  System  (CAMM) ,  the 
Defence  Supply  Retai  I  Management  system  (DSRMS)  ,  and  the  RAAF 
Procurement  and  Provisioning  model  (PATRIC). 
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NRLA  data  requirements  that  could  not  be  met  from 
existing  RAAF  sources  were  h i gh I ighted  as  factors  I imiting 
the  introduction  of  NRLA  to  the  RAAF.  However,  investigating 
a  i  -  r>->  t  i  ve  forms  of  data  support  wes  cnr.5  itemed  beycnd  the 
scope  of  this  thesis. 

Interview  Limitations 

The  purpose  of  the  forma  I  interviews  was  to:  verify  that 
pub  I  i  shed  RLA  guidelines  were  being  foil  owed  in  practice, 
confirm  the  perceived  drawbacks  of  RAAF  RLA  establ  i  shed  in 
chapters  I  and  II,  and  highlight  any  additional  dr  awbacks  o  f 
the  present  RLA  procedures.  Accordingly,  those  selected  for 
interviews  were  required  to  have  personal  experience  in  the 
practical  appl ication  of  RLA  or  the  development  of  RLA 
po I  icy. 

Seven  people  were  interviewed.  The  relevant  experience 
of  these  seven  individuals  is  contained  at  Appendix  E.  Two 
of  those  interviewed  were  involved  in  the  RLA  po I i cv  area, 
and  the  other  five  per  formed  RLA  on  the  B I ackhawk  he  I  icopter 
project.  While  a  samp le  size  of  seven  may  appear  sma II,  it 
should  be  noted  that: 

a.  there  are  only  eight  Repair  Level  Analysis  positions 
establ  ished  in  CAPPROJ .  At  the  time  of  the  interviews, 
four  of  the  eight  people  in  those  positions  had  no 
practical  experience  in  RLA  (a  fifth  analyst  was 
i n  t er  v 1 ewed  at  his  foil ow- on  posting)  ,  and 
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b.  in  DMP-AF  there  are  only  a  maximum  of  two  people 
actively  involved  with  RLA  po I  icy.  These  two 
individuals  also  review  the  CAPPROJ  RLA  decisions. 

The  RLA  e . .  per  lance  of  must  of  thoee  interviewed  was 
I imited  to  the  recent  BlackHawk  project.  Although  it  would 
have  been  desirable  to  have  respondents  with  both  present  and 
past  RLA  experience,  it  was  not  possible.  This  was  because 
personnel  with  earl ier  RLA  experience  have  moved  to  other 
positions  or  out  of  the  RAAF  two  to  three  years  ago,  and 
would  not  be  current  on  present  RLA  procedures.  Nonetheless, 
general  conclusions  on  RLA  can  be  drawn  from  the  comments  of 
those  interviewed  because: 

a.  RLA  principles  and  procedures  are  the  same,  no 
matter  what  aircraft  or  major  system  is  being  dealt 
with;  and 

b.  the  BlackHawk  project  was  the  last  major  RLA  effort 
in  the  RAAF  and  as  such  the  procedures  used  reflect  the 
most  current  practical  methods  of  RLA. 

Because  of  the  limited  number  of  qualified  people  and 
the  distance  involved,  the  interviews  were  conducted  by 
telephone.  There  are  certain  recognised  I  imitations  of 
telephone  interviews.  The  two  major  I  imitations  include:  not 
al I  respondents  may  be  available  by  telephone,  and  it  is  not 
possible  to  use  illustrations  to  explain  a  point  (16:171). 

In  certain  types  of  research  these  create  true  I  imitations, 
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however,  in  this  research  al I  known  respondents  were  reached 
by  telephone,  and  al I  respondents  had  a  working  knowledge  of 
RAAF  RLA . 

Interview  Pre-Test 

The  initial  set  of  interview  questions  is  contained  in 
Appendix  F.  These  questions  were  tested  during  discussions 
with  Squadron  Leader  K.  Henderson.  Squadron  Leader  Henderson 
has  RLA  experience  on  both  the  Squirrel  arid  Blackhawk 
projects.  As  a  result  of  this  question  pre-test,  the 
original  questionnaire  was  amended  by: 

a.  reducing  a  Liiree  point  response  scale  of 

unsa t i s f ac tor y  -  satisfactory  -  very  satisfactory  to  a 
two  point  response  scale  of  satisfactory  - 
unsat i sfactory , 

b.  rewording  Part  2  question  5  from  "how  do  you 
describe  the  present  method  of  compar i ng  I ife  cycle 
costs  for  repair  alternatives?"'  to  How  would  you 
describe  the  mechanics  of  completing  RLA  once  data  has 
been  collected?", 

c.  removing  part  2  question  7  as  it  was  an  area  where 
most  respondents  would  not  have  any  knowledge,  and 

d.  removing  the  second  question  deal ing  with  the 
experience  required  to  conduct  RLA  as  it  was  considered 
redundant . 
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The  process  of  pre-testing  the  questions  was  I imi ted  to 
a  single  individual  because  of  the  sma I  I  number  of 
know ledgeable  people  available  for  intervi ews .  Since  there 
was  little  change  to  the  original  questionnaire,  Squadron 
Leader  Henderson’s  comments  during  the  pre-test  were  included 
with  other  interview  responses. 

Interview  Questions 

The  amended  questionnaire,  used  in  the  formal 
interviews,  is  in  Appendix  G.  The  interviews  were  conducted 
by  telephone  in  May  1989. 

The  first  part  of  the  interview  dealt  with  procedural 
questions.  The  purpose  was  to  check  and  va I idate  the  RAAF 
RLA  process.  Chapter  I  I  deta i  Is  how  the  RAAF  should  conduct 
RLA  according  to  publ  ished  procedures  and  guidei  ir.es.  The 
first  part  of  the  interview  therefore  provided  a  means  of 
checking  whether  these  procedures  were  reflected  in  practice. 
The  information  obtained  addresstr  investigative  question  1b. 

The  second  part  of  the  interview  el  i c  i  ted  opinions  on 
present  RAAF  RLA  procedures.  Figure  5  shows  which  interview 
questions  related  to  which  step(s)  in  the  RLA  process.  Each 
question  was  asked  in  two  stages.  Initially  respondents  were 
asked  to  express  an  opinion  about  a  particular  aspect  of  RLA. 
A  dichotomous  satisfactory  -  not  satisfactory  response  scale 
was  used.  This  simple  scale  was  preferred  to  a  Lickert  type 
scale,  as  the  purpose  of  the  questions  was  not  to  col lect 


Figure  5.  RAAF  RLA  Process  with  interview  Questions 
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data  for  statistical  analysis,  but  rather  to  provide  insight 
for  the  second  stage  of  questioning,  which  involved 
clarifying  ’why’  respondents  felt  the  way  they  did. 

For  example,  to  Part  2  question  4,  "How  would  you 
describe  your  discussions  with  DMP-AF  when  trying  to  resolve 
data  col  lection  inadequacies’";  a  respondent’s  response  of 
"not  satisfactory"  in  itself  is  not  mean i ng  f  u I  .  However ,  by 
asking  why  it  is  not  satisfactory,  opinions  on  the 
inadequacies  (or  strengths)  of  the  presen*’  system  were 
ob  ta i ned . 

In  addition  to  general  questions  on  RAAF  RLA  procedures, 
Part  2  contained  a  specific  question  on  allocating  support 
equipment  costs  (Part  2  question  2).  In  chapter  I  RAAF 
management’s  perception  that  existing  procedures  are  not 
adequate  for  al locating  support  equipment  costs  was 
highlighted.  The  purpose  of  the  question  was  to  confirm  if 
there  are  any  practical  problems  in  al locating  support 
equipment  costs  using  present  RAAF  RLA  methods. 

Part  2  of  the  questionnaire  also  contains  a  specific 
question  on  conducting  sensitivity  analysis  in  the  RAAF.  In 
chapter  II  the  ease  of  using  IMR  LA  in  the  USAF  for  sensitivity 
analysis  was  high  I  ighted.  The  purpose  of  this  question  was 
to  determine  if  it  is  difficult  to  perform  sensitivity 
analysis  using  existing  RAAF  RLA  methods. 
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The  information  obtained  from  Part  2  of  the  interview 


addressed  investigative  questions  3a  and  3b. 

In  Chapter  I,  RAAF  management’s  expectation  that  NRLA 
would  provide  a  more  scientific  approach  to  RLA  was 
highlighted.  The  belief  was  that  a  mor  e  scientific  approach 
wo u I d  me an  less  reliance  on  the  experience  and  expertise  of 
the  individual  doing  the  analysis. 

The  purpose  of  the  third  part  of  tne  interview  was  to 
gain  expert  u  p  ! . .  i  o  r,  cn  how  scientific  or  quantitative  the 
present  RAAF  RLA  methods  are  in  terms  of  expertise  required 
to  do  an  analysis.  This  information  was  used  later  to 
compar e  the  RAAF  approach  with  the  scientific  rigor  offered 
by  NRLA. 

The  information  obtained  from  par t  3  of  the  interview 
addressed  investigative  questions  3a  and  3b. 

Summa  -•  y 

The  purpose  of  this  chapter  was  to  explain  the 
methodology  that  was  used  to  answer  the  research  questions 
posed  in  chapter  I .  Methods  used  to  investigate  the  three 
research  questions  included: 

a.  reviews  of  RAAF  and  USAF  orders  and  instruct  o ns, 

b.  informal  interviews  with  RAAF  and  USAF  repair  level 

analysts,  and 

c.  formal  telephone  interviews  with  RAAF  analysts. 
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Overv  ,  ew 


IV.  Findings  and  Analysis 


This  chapter  reports  the  findings  of  this  research  and 
provides  an  analysis  of  data  col lected  in  support  of  the 
research.  The  results  of  the  interview  process  are 
summar i led  first.  This  interview  data  is  Then  combined  with 
background  material  from  chapter  I  I  to  address  the  thesis 
research  questions. 

Interview  Questions 

The  interview  questions  are  I isted  at  Appendix  G.  A 
list  of  those  intervi ewed  and  their  relevant  experience  is 
contained  at  Appendix  E.  A! I  those  interviewed  had  a  working 
knowledge  of  the  RAAF  RLA  process.  The  interviews  dealt  with 
questions  on  general  RLA  procedures,  respondent's  oersonal 
oo i n i ons  of  present  methods,  and  opinions  about  the 
scientific  rigor  of  R  LA  procedures.  Detai  led  i nterv 1 ew 
responses  are  contained  in  Appendix  H. 

Procedural  Questions.  The  purpose  of  the  procedura 
questions  was  to  confirm  if  RAAF  RLA  guidel i nes  were  beinq 
foil  owed  in  practice.  The  interview  results  are  summa  r  i zed 
be  I ow . 

Repair  level  analysts  decide  if  a  ccnponent  is 
ntr  msical  ly  repairable  or  not  through  the  application  cf 
common  sense,  and  where  app I icable,  USDoD  Source,  Maintenance 
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and  Recoveraci I i ty  (SMR)  codes.  SMR  codes  provide 
information  on  the  maintenance  level  and  repair  action  for  a 
component  as  determined  by  the  USDoD  (12:3) . 

Common  sense  is  used  to  make  the  obvious  decisions  such 
as  nuts  and  bolts  being  non  repairable.  SMR  codes  are  used 
for  guidance  if  the  decision  to  repair  is  likely  to  require 
special  suDport  equi pmen  t  and  facilities. 

A  SMR  coding  of  “repairable"  would  indicate  that  support 
equipment  had  been  developed  for  a  component,  and  that 
alternative  repair  level  actions  should  be  investigated  by 
the  RLA  analyst.  On  the  other  hand,  a  SMR  coding  of 
"expendable"  would  make  it  uni  ikely  that  special  ist  support 
equipment  had  been  developed.  This  would  favor  a  'discard  on 
failure"  policy  for  the  RAAF  because  of  the  I  united  resources 
available  to  develop  the  required  support  equipment  in 
Aus  t  r  a  I  i a . 

The  cost  elements  considered  by  RAAF  analysts  are  I isted 
in  Appendix  B.  On  the  BlackHawk  project,  individual  analysts 
were  first  asked  to  determine  their  own  standard  cost 
figures.  The  analysts  were  then  bought  together  as  a  group 
and  a  standard  cost  for  each  element  was  obtained  by 
consensus . 
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the  RLA  process.  This  approach  was  also  necessary,  as 
ex  sting  RLA  instructions  do  not  provide  any  information  on 
the  sources  of  cost  element  data,  or  the  standardization  of 
such  data. 

Where  appl icable,  RAAF  analysts  used  repair  level 
decisions  by  overseas  Services  as  a  starting  point  for  RAAF 
RLA.  For  example,  if  an  item  had  been  annotated  as  depot 
repairable,  the  analyst  knew  that  support  equipment  existed 
or  that  it  was  being  developed  to  service  the  component. 

In  addition,  analysts  have  used  USDoD  Logistics  Support 
Analysis  (LSA)  data  as  the  basis  for  developing  standardized 
cost  elements.  The  USDoD  requires  LSA  to  be  conducted  on  al I 
acquisitions  of  major  equipment.  LSA  provides  cost  data  on 
ma intenance,  supply,  and  other  support  requir  emen  t s  (13:10). 

However,  analysts  are  aware  the  LSA  data  cannot  always 
be  directly  appl i ed  to  RAAF  RLA.  For  example,  USDoD 
publ  ication  costs  usual  ly  include  the  cost  of  initial 
development  and  production.  The  cost  to  the  RAAF  would  not 
include  any  development  costs,  but  would  include  costs  of 
changes  in  the  publ ications  to  meet  RAAF  maintenance 
pr  ac  t i ces . 

Even  if  reliable  overseas  information  is  available,  f u l 
costing  of  each  alternative  is  still  conducted  to  determ  ' ■_ 
the  most  economical  approach  from  the  RAAF  point  of  view. 

For  instance,  a  component  that  is  repaired  at  a  depot  in  the 


USA  may  be  more  economical  to  repair  at  an  intermediate 
workshop  in  Austral ia,  or  alternatively  the  low  number  of 
arisings  in  Austral ia  may  make  it  more  economical  to  send 
components  to  the  USA  for  repair. 

Opinions  of  Present  Methods,  The  purpose  of  the 
questions  deal i ng  with  opinions  of  present  methods  was  to 
determine  the  strengths  or  weaknesses  of  the  present  method 
of  RLA.  Comments  made  in  that  part  of  the  interview  are 
summarized  below. 

General ly,  the  analysts  interviewed  were  satisfied  with 
the  consensus  approach  to  determining  standardized  cost 
figures.  However,  they  expressed  concern  over  the  accuracy 
and  the  sources  of  data  used  to  determine  the  estimates. 

For  ex amp le,  initial  publication  costs  varied  in  price 
depending  on  the  source  of  the  data.  In  addition,  inventory 
cataloging  costs  had  no  identifiable  source  at  all.  in  both 
cases  a  standardized  'best  guess’  was  determined  by  the 
analysts  rather  than  basing  the  cost  on  some  source  of 
reliable  data . 

The  proper  al location  of  support  equipment  costs  seems 
to  be  a  particular  problem  for  analysts.  In  the  initial  RLA 
on  the  B I ackHawk ,  the  fu I  I  cost  of  support  equipment  was 
logged  against  each  item  that  required  the  support  equipment. 
Later ,  this  was  changed  so  that  support  equipment  costs  were 
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apportioned  between  al I  of  the  items  using  the  test 
equ i pmen  t . 

Even  so,  respondents  expressed  concern  over  apportioning 
the  costs  of  new  support  equipment  as  we  I  I  as  the  costing  of 
new  component  usage  of  existing  support  equipment.  They 
found  it  difficult  to  properly  attribute  costs  based  on 
supoort  equipment  usage,  especial ly  where  parent  assemb I i es 
and  sub  assemb I i es  used  the  same  test  equipment. 

CAPPROJ  analysts  interviewed  did  not  appear  to  have  been 
required  to  conduct  formal  sensitivity  analysis.  Even  so, 
DMP-AF  stef*  have  said  that  in  recent  times  the  need  for 
sensitivity  analysis  has  increased  as  "what  if”  questions 
associated  with  civi  I  versus  mi  I  ita-'y  ma  intenance  of  major 
components  are  investigated. 

Those  interviewed  be  I  i eved  that  any  sort  of  sensitivity 
or  "what  if"  type  of  analysis  would  be  time  consuming.  This 
is  because  RAAF  RLA  is  largely  a  manual  process  and  changing 
any  input  parameter  would  require  the  whole  RLA  process  to  be 
repeated . 

Although  published  guidelines  indicate  that  probl ems  i n 
determining  accurate  cost  elements  should  be  resolved  with 
DMP-AF,  in  real ity,  CAPPROJ  sorts  out  the  problems  themselves 
and  documents  this  for  DMP-AF  to  review  at  the  end  of  the  RLA 
process  after  a  final  repair  po I  icy  is  recommended. 
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The  RLA  experts  interviewed  were  general ly  satisfied 
with  the  mechanics  of  the  RAAF  RLA  process,  after  cost 
elements  were  determined.  For  simple  components  that  do  not 
require  proportional  allocation  of  support  equi pme n t  costs, 
the  present  methods  of  RAAF  RLA  were  considered  adequate. 

The  procedures  and  forms  used  to  perform  RAAF  RLA  are 
identical  to  those  outlined  in  chapter  II.  The  only 
variation  is  the  use  of  a  DBASER  computer  program  to  automate 
the  summation  of  the  various  maintenance  alternative  I  i  f e 
eye  I e  costs . 

Complaints  about  the  present  procedure  for  determining 
alternative  I  i  fe  cycle  costs  included  the  need  to  run  the 
provisioning  model  PATR I C  for  each  maintenance  alternative. 
Each  PATRIC  run  takes  several  hours  to  set  up  and  complete. 
This  is  a  time  consuming  task. 

The  repair  level  analysts  surveyed  expressed  I  ittle 
difficulty  in  dealing  with  DMP-AF  staff  when  ma i ntenance 
po I i c i es  were  being  reviewed.  General ly,  questions  from  DMP- 
AF  dealt  with  the  assumptions  used  for  establ i sh i ng  the  cost 
estimates.  In  most  cases,  DMP-AF  accepted  CAPPROJ  cost 
estimates  as  soon  as  further  explanation  was  provided. 

Scientific  Rigor  of  Present  Methods.  The  purpose  of  the 
third  par t  of  tho  interview  was  to  gain  expert  opinion  on  how 
scientific  or  quantitative  the  present  RLA  method  is.  This 
data  will  be  used  later  to  compare  with  the  scientific  rigor 
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offered  by  NRLA.  The  assumption  here  is  that  a  more 
quantitative  approach  would  involve  less  reliance  on  the 
experience  or  qualifications  of  the  individual  performing  the 
ana  lysis. 

There  was  disagreement  between  the  respondents  over  the 
degree  of  experience  required  to  conduct  RAAF  RLA.  Some 
argued  that  al I  that  was  required  was  enthusiasm  and  a 
background  in  the  app I  icable  aircraft  or  trade. 

Others  argued  that  in  addition  to  having  the  right 
background,  experience  in  spares  assessing  or  staff  work  in 
the  repa i r  and  overhaul  area  would  be  an  advantage.  When  RLA 
cost  elements  were  being  standardized  there  appeared  to  be  a 
Heavy  i e ii once  on  those  individuals  with  experience  in  those 
areas  of  HQSC .  The  assumption  here  suggests  that  people  with 
such  experience  would  be  better  able  to  identify  and  pursue 
data  sources  for  RAAF  RLA  cost  inputs. 

Research  Questions 

The  information  gathered  in  the  interview  process  and 
the  I  i  terature  review  will  now  be  used  to  address  each  of  the 
three  research  questions. 

Research  Question  1 .  How  does  the  RAAF  perform  Repair 

Level  Ana  lysis? 

A  review  of  the  worksheets  completed  by  RLA  analysts  on 
the  recent  B I ackhawk  he  I  icopter  project  revealed  that  the 
procedures  contained  in  HQSC  branch  instructions  are  being 
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fo! lowed  in  practice.  A  random  selection  of  airframe,  engine 
and  avionic  component  repair  level  analysis  work  sheets  were 
analyzed.  A! I  used  the  performas  suggested  in  the 
instructions  and  al I  appeared  to  consider  the  relevant  cost 
factors  in  their  analysis. 

Interviews  with  repair  level  analysts  confirmed  that,  in 
almost  al  I  cases,  theory  was  being  fo  I  lowed  in  practice,  as 
outlined  in  Figure  4  of  chapter  II.  The  only  exception  to 
the  publ  ished  procedure  was  that  cost  data  col  lection 
problems  were  resolved  within  CAPPROJ  rather  than  being 
referred  to  DMP-AF  for  resolution.  This  procedure  does  not 
circumvent  DMP-AF  authority,  as  the  va I idity  of  cost 
estimates  can,  and  is,  questioned  by  DMP-AF  during  the  review 
lase  of  the  RLA  process.  Therefore  the  intent,  if  not  the 
letter  of  the  HQSC  branch  instruction  is  being  fo I  lowed. 

Research  Question  2.  How  does  the  USAF  perform  Repair 

Level  Analysis  using  the  Network  Repair  Level  Analysis 

mode  I ? 

The  USAF  RLA  process  consists  of  both  screening 
procedures  and  detailed  analysis  procedures.  The  screening 
procedures  use  simple  a  I gor  i thms  to  make  "obvious"  repair 
level  decisions  for  some  system  components.  However,  if  the 
assumptions  of  these  procedures  cannot  be  met,  more  detai  led 
analysis  is  performed. 

The  first  level  of  detailed  analysis  is  Marginal  Repair 
Level  Analysis  (MRLA) .  In  MARLA,  costs  are  al located  as 
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either  repair  or  p i pe I i ne  costs  and  repair  decisions  are  made 
by  compar i ng  the  cost  "to  discard"  to  the  sum  of  p i pe I i ne  and 
suppor  t  costs. 

The  next  level  of  analysis  is  I  tern  Repair  Level  Analysis 
(IRLA).  IRLA  is  similar  to  MARLA ;  however ,  indentured 
relationships  between  LRUs  and  SRUs  are  acknowledged  and  the 
cost  of  support  equipment  is  al located  on  the  basis  of  actual 
use  . 

Network  Repair  Level  Analysis  (NRLA)  is  the  most  complex 
method  of  USAF  RLA,  it  uses  a  systems  approach  and  provides 
the  capacity  to  analyze  a  sma I  I  system  or  sub  system  in  one 
i  ter  at i on . 

The  USAF  regards  NRLA  as  the  preferred  method  of 
conducting  RLA  (15:12).  However ,  in  practice,  NRLA  is  only 
used  for  cor„pMents  and  sub-assemb  I  i  es  which  possess  a 
complex  relationship  between  SRUs  and  LRUs.  This  procedure 
prevents  the  unnecessary  use  of  computer,  and  data  col  lection 
time  for  components  that  could  be  accurately  analyzed  using 
the  simpler  RLA  techniques  descr  i  bed  above  (22)  . 

In  practice,  NRLA  is  usual ly  conducted  by  the  contractor 
using  data  obtained  from  the  appl icable  aircraft  LSA . 

Because  NRLA  is  computer  based  and  the  information  is 
ava  i  I ab I e  in  the  required  format,  the  background  of  those 
performing  NR  LA  can  be  varied  (22).  Aircraft  trade  or  spares 
assessing  experience  is  not  necessary.  All  that  is  required 
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is  the  ability  to  take  the  applicable  LSA  data  and  enter  it 
into  the  NRLA  model . 

NRLA  uses  life  cycle  costs  together  with  LRU/SRU/SE 
interdependency  relationships  to  construct  a  network 
representat i on  of  the  repair  level  decision  problem  (3:1). 
Support  equipment  costs  are  automatically  attributed  to  SRUs 
and  LRUs  by  NRLA  on  the  basis  of  LRU/SRU/SE  interdependency. 
There  is  no  need  to  manu  a lly  attribute  support  equi pmen  t 
costs  to  each  component  in  the  system  being  analyzed. 

Additionally,  sensitivity  analysis  and  changes  to  input 
data  can  be  accommodated  in  NRLA  by  simply  changing  one  or 
two  data  cards. 

Research  Question  3.  Should  the  RAAF  use  the  USAF 

Network  Reoa i r  Level  Analysis  model  to  perform  Repa i r 

Leve I  Analysis? 

i he  t-iAAF  RLA  analysts  interviewed  reported  that 
publ ished  RLA  procedures  and  guidel i nes  were  easy  to  fol low. 
However ,  they  believed  that  the  orders  were  not  specific 
enough  on  how  to  gather  data  and  determine  specific  cost 
elements.  As  a  result,  analysts  initially  had  to  rely  on 
their  personal  experience  to  determine  costs.  This  meant 
that  interpretations  and  costs  varied  widely  between 
analysts. 

As  a  result  of  their  experience  on  the  Blackhawk  RLA, 
analysts  have  suggested  a  way  of  tightening  up  existing  RLA 
procedures.  During  the  interview  stage  of  this  research,  and 
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in  earl ier  written  comments  on  the  Blackhawk  RLA  process, 
analysts  have  suggested  that  at  the  start  of  the  RLA  process: 

a.  the  importance  of  each  cost  element  to  each  repair 

alternative  should  be  determined,  and 

b.  standardized  costs  for  each  element  should  be 

spec i f i ed  (19:1). 

For  example,  training  costs  for  throw  away,  overseas  ana 
contractor  ma intenance  alternatives  were  regarded  as  nil  for 
the  Blackhawk  project  and  the  standard  recurring  cost  of 
training  for  other  alternatives  was  specified  as  $50  per  hour 
(19: A2) . 

Analysts  in  the  Blackhawk  program  reported  that  if  they 
u  2d  :  r,  format  i  on  on  standardized  costs  and  the  applicability 
of  the  various  cost  elements  to  repair  alternatives  at  the 
beginning  of  the  RLA  process,  they  would  have  cut  the  time 
spent  on  RLA  by  more  than  50%  (19:2). 

However  ,  as  discussed  earl ier  in  this  chapter,  for 
par t  i  cu I ar  cost  elements  such  as  publ  ication  and  inventory 
costs  for  example,  there  are  problems  in  either  identifying 
sources  for  the  data  or  having  the  data  in  the  right  form  in 
which  to  develop  standardized  costs. 

Other  drawbacks  of  existing  RAAF  RLA  procedures 
identified  in  the  interview  process  include  difficulties  in 
al locating  support  equipment  costs  to  al low  for  LRU/SRU 
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interdependencies,  and  the  need  to  completely  rework  the  RLA 
of  a  component  when  conducting  sensitivity  analysis. 

In  summary,  what  is  not  being  done  that  should  be  done 
i n  RAAF  RLA  is: 

a.  identifying  where  data  can  be  obtained  to  develop 
standardized  cost  elements, 

b.  manipulating  data  from  existing  sources  to  make  it 
suitable  for  developing  standardized  cost  elements, 

c.  developing  better  methods  for  al locating  support 
equipment  costs  between  multi  use  items,  and 

d.  developing  easier  ways  to  perform  sensitivity 
analysis. 

Establ  ishing  what  is  not  being  done  that  should  be  done 
in  RAAF  RLA  was  the  first  step  in  answering  research  question 
3.  The  second  step  was  to  determine  what  improvements  NRLA 
offered  over  existing  RAAF  procedures.  The  final  step  was  to 
determine  if  NRLA  data  requirements  could  be  satisfied  from 
existing  RAAF  resources. 

The  NRLA  approach  does  offer  improvements  over  the 
existing  methods  of  RAAF  RLA  in  al locating  support  equipment 
costs,  and  performing  sensitivity  analysis. 

Present  RAAF  RLA  methods  al locate  support  equipment 
costs  manual ly  on  the  basis  of  component  usage.  Furthermore, 
because  cost  al locations  are  done  on  a  component  by  component 
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basis,  there  is  no  means  of  systematical ly  taking  into 
account  system  wide  SRU/LRU  interdependencies. 

On  the  other  hand,  NRLA  al  lows  the  r e I  a t i onsh i ps  between 
SRU ’ s  and  LRU’s  to  be  modeled  as  a  network.  Support 
equ i pmen t  costs  are  a u toma t i ca I  I y  attributed  to  SRUs  and  LRUs 
by  NRLA  on  the  basis  of  LRU/SRU/SE  interdependency.  NRLA 
provides  a  system  wide  optima!  repair  solution  rather  than  an 
individual  component  solution  as  is  the  case  with  existing 
RAAF  procedures. 

A  standard  NRLA  output  can  contain  an  initial  solution 
and  several  different  sensitivity  analyses  for  a  complex 
component  or  subsystem.  Furthermore,  sensitivity  analysis 
and  changes  to  input  data  can  be  accommodated  by  changing  one 
or  two  data  cards.  In  contrast,  conducting  sensitivity 
analysis  using  RAAF  RLA  procedures  requires  the  entire  manual 
process  to  be  repeated,  as  if  a  new  component  was  being 
eva I ua  ted . 

if  NRLA  is  to  be  used  by  the  RAAF  to  improve  RLA  in  the 
areas  of  support  equi pme nt  allocation  and  sensitivity 
analysis,  NRLA  data  input  requirements  must  be  satisfied 
(refer  Appendix  A) .  In  the  USDoD  such  data  is  readi ly 
available,  as  it  is  required  under  the  provision  of  USDoD  LSA 
(13:3) .  However ,  as  has  been  discussed  earlier  in  this 
chapter,  in  Austral  1a,  RLA  data  is  not  as  readi  ly  ava i  I ab I e . 


Interviews  with  RAAF  analysts  and  correspondence  on 
recent  RAAF  RLA  programs  reveal  that  there  are  problems  with 
identifying  sources  of  RLA  data,  and  where  sources  are 
ava i I ab I e ,  man ipulating  the  data  to  get  it  into  an  acceptable 
form  to  determine  standardized  cost  elements.  Furthermore, 
although  USDoD  data  is  used  by  RAAF  analysts  to  aid  in  the 
RLA  process,  the  analysts  have  noted  that  the  data  must  be 
modified  to  reflect  the  RAAF  environment. 

The  RAAF  analysts  interviewed  indicated  that  if  these 
data  col  lection  problems  could  be  overcome,  the  existing 
method  of  RAAF  RLA  would  be  adequate  for  analyzing  simple 
components.  In  addition,  individuals  wo uld  not  be  required 
to  seek  out  and  interpret  cost  element  data  as  part  of  the 
RLA  process. 

Developing  an  expert  system  to  satisfy  the  data 
requ i rements  of  RAAF  RLA  is  the  subject  of  a  separate  study 
(20:1).  Accordingly,  the  mechanics  of  extracting  information 
from  specified  sources  and  modifying  it  for  input  to  NRLA  or 
the  existing  method  of  RAAF  RLA  has  not  been  investigated. 
Although  such  an  investigation  is  beyond  the  scope  of  this 
research,  a  brief  survey  of  the  possible  sources  of  data  for 
RAAF  NRLA  based  RLA  is  provided  in  Table  1  . 

The  first  column  in  the  table  I ists  the  data  input 
r equ i r emen ts  for  NRLA,  mdensed  form.  It  is  based  on  the 

detailed  NRLA  input  requ  ;ien  ts  contained  at  Appendix  A. 


Table  1 :  NRLA 


RAAF  RLA 


Data  Sources 


1 

Condensed  NRLA 

Requ i r ements  ( 1 ) 

RAAF  RLA  (2) 
Requ i r emen  ts 

, 

Poss i b 1 e  | 

Sources 

1 .  Weapon's  System 

a.  End  use  requirements 
b  .  Oper at i ons 
requ i remen  ts 
c.  Sensitivity  analysis 

1 

requ i rements  (3) 

RAAF  RLA 
Record 

1 

RmAF  Operational 

Requ i r emen  t . 

2.  Maintenance  System 

a.  Manhour  costs 

b.  Manhour  capacity 

c.  Turnover  rates 

Ma  i  n  te  nance 
Manpowe r 

Staff  Officer  Repair 
ard  Overhaul  (S0R0) ; 

1 

Director  of  Costing; 
Director  of  °ostings 

A i r me  n  ( DPA )  . 

3 .  Supply  Sys  tern 

a.  Inventory  management 

b .  Lead  t i mes 

c .  Packaa i ng  and 
hand  1  i ng 

d.  Transportat ion  costs 

1 

1 nven  tor  y 
Managemen  t : 
Transpor  t , 
Packag i ng , 
Hand  ling; 
Stanoar ds 

Head  Quarters  Support! 
Command  Support 

Groups  (HQSC-SG) .  ! 

[  -  -  - 

4.  Support  Equipment 

a.  support  equipment 
requ i rements/  costs 

b.  availability  of 
existing  equipment 

c.  facilities  cost 

1 

Suppor  t 

Equ i pmen  t ; 

Fac i l i t i es ; 

Sof twa r  e 

! 

Manu  facturer  ; 

Depar  tmen  t  of 

Adm inistrative 

Services; 

HQSC  -  AEENG6 ; 

User  unit 

5.  LRU  Data 

a.  LRM  description 

b.  LRU  removal/  repair 
t  i  mes 

c .  MTBF  data 

d.  General  support 
requ  i r  erne  n  t  s 

I 

1 

RLA  record 

T  oo  ling 

i 

Manufacturer ; 

S0R0  ; 

HQSC  -  AEENG6 ; 
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Table  1 :  NRLA 


RAAF  R  LA 


Data  Sources  (Continued) 


Condensed  NRLA 

RAAF  RLA  (2) 

Poss  i  b 1 e 

Requ i rements  ( 1 ) 

Requ  i r  emen  ts 

Sources 

6 .  uRU  Data 

a.  SRU  description 

RAAF  RLA 

Manu  f ac  tur er ; 

b.  Types  of  failure 

record ; 

HQSC-SG ; 

c.  Parts  required  to 

Spar  es , 

HQSC-  Ground  Training 

r  epa i r 

Co  nsumab 1 es ; 

HQSC-  Publ  ications 

d.  personnel  required 

Training; 

Director  of  Costing; 

to  r e pa i r 

Ma  i  n  tenance 

S0R0  ; 

e.  training  requ i red 

Publ  i  ca  t  i  on 

DPA  ; 

to  r epa i r 

Cos  t  s ; 

f.  technical 

Ma i n  tenance 

publ  icat ions  req’d 

Manpower . 

I  7.  SRU  Fai lure  Mode 

I 

a .  T ypes  of  failure 

RAAF  RLA 

Manu  fac  tur er  ; 

b .  Assoc i a  ted  SRU 

record ; 

HQSC-SG ; 

c.  Parts  required  to 

Spares , 

HQSC-  Ground  Training 

r  e pa  i  r 

Consumab 1 es ; 

HQSC-  Publications 

d.  personnel  required 

Training; 

Director  of  Costing: 

to  r epa i r 

Ma  i  ntenance 

SCRO  ; 

e.  training  required 

Publ  i  ca  t i o  n 

DPA  ; 

}  to  r  epa i r 

Costs ; 

I  f .  technical 

Ma  i  ntenance 

j  publications  req'd 

Manpower . 

|  8.  LRU /SRU / SE  Cross 

Re  f er ence 

1 

a.  Relationship  between 

- 

Manu  facturer 

LRU,  SRU  and  SE  (3) 

1 

Da  t  a  Pr  oc  ess 

Compute’"  Services 

1 

Support  (4) ; 

Division; 

Engineer ing 

Director  o  f  Cost.’  n  q  . 

Mnagemn  t  ( 4 ) 

Notes : 

1.  see  Appendix  A  for  comp  I ete  listing  of  NRLA  input 
r  equ  i r  emen  ts . 

2.  see  Appendices  Q,C,  and  D  for  more  detail  on  RAAF  RLA 
input  requirements. 

3.  preliminary  survey  shows  no  apparent  equivalent  data 
input  requirement  for  RAAF  RLA, 

4.  pro  I iminary  survey  shows  no  apparent  equivalent  data 
input  requirement  for  NRLA. 
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Column  2  lists  the  input  requirements  for  the  existing  RAAF 
RLA  orocedures  as  they  relate  to  the  NRLA  inputs.  Detai  led 
RAAF  RLA  input  requirements  are  soec i f i ed  in  Appendices  B  and 
D. 

There  is  not  an  unique  one-to-one  relationship  between 
NRLA  and  RAAF  RLA  data  requirements,  as  NRLA  is  more 
comprehensive  and,  therefore,  requires  more  detai  led  inputs 
than  RAAF  RLA.  However,  Table  1  does  show  that  simi I ar 
factors  are  considered  in  both  methods  of  RLA,  only  the  level 
of  detail  and  input  comb inat ions  differ. 

Column  3  of  the  Table  1  identifies  possible  sources  of 
RAAF  data  for  the  various  RLA  inputs.  These  sources 
represent  prel iminary  contacts  and  any  refinement  or 
detai  I  i  ng  of  the  sources  should  be  the  subject  of  future 
investigation.  As  stated  previously,  the  mechanics  of 
extracting  and  modifying  data  for  use  in  NRLA  or  RAAF  RLA  is 
beyond  the  scope  of  this  study.  It  should  be  noted  that,  in 
addition  to  the  sources  listed,  mod ■  f  ' sd  LSA  data  f  r cm 
equivalent  USDoD  major  equipment  and  aircraft  could  be  used 
to  determine  RLA  costs. 

If  data  input  requirements  for  the  existing  RAAF  RLA 
procedures  and  NRLA  based  procedures  can  be  resolved,  the 
RAAF  can: 

a.  use  the  existing  RAAF  procedures  for  analysis  of 

simple  components,  and 


b.  use  NRLA  for  more  complex  components  or  subsystems 
where  a! locating  support  equipment  costs  or  conducting 
sensitivity  analysis  is  important. 

Summar  y 

An  analysis  of  the  data  col lected  in  this  research  shows 
that  there  are  four  major  problems  with  the  present  RAAF  RlA 
methods.  These  include: 

a.  identifying  where  data  can  be  obtained  to  determine 
standardized  cost  elements; 

b.  manipulating  data  from  existing  sources  to  make  it 
suitable  for  developing  standardized  cost  elements; 

c.  developing  better  methods  for  a  I  locating  support 
equipment  costs  between  multi  use  items;  and 

d.  developing  easier  ways  to  perform  sensitivity 
analysis. 

NRLA  can  address  the  latter  two  problems,  provided  NRLA 
data  input  requirements  can  be  satisfied.  To  improve 
existing  RLA  methods  or  successful  I y  introduce  a  NRLA  based 
RLA,  data  specification  and  sourcing  difficulties  mu  s  t  be 
so  I ved . 

The  mechanics  of  extracting  information  from  C3ta 
sources  and  modifying  it  for  input  to  NRLA  or  the  existing 
method  of  RAAF  RLA  has  not  been  investigated  and  is  beyond 
the  scope  of  this  research.  However,  the  researcher  has 
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provided  a  survey  of  the  possible  sources  of  data  for  RAAF 


NRLA  based  RLA  at  Table  1 . 

Conclusions  and  recommendations  made  as  a  result 
research  are  contained  in  the  fol lowing  chapter . 


of  this 
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V  .  Conclusions  and  Re commend a  t i ons 


Over  v i ew 

The  purpose  of  this  research  was  to  evaluate  the 
suitability  of  l\JR  LA  as  the  pr  imar  y  Repair  Level  Analysis  tool 
for  the  RAAF . 

DMP-AF  and  CAPPROJ  are  concerned  about  the  way  RLA  is 
currently  being  conducted  in  the  RAAF  (21,  5:1,  19:1-3).  At 

present  RLA  is  conducted  using  a  broad  set  of  procedures 
developed  in  1981.  RAAF  RLA  for  complex  equipment  or  sub 
systems  is  described  as  a  mixture  of  engineering  judgement 
and  black  mag i c  (17:1).  RAAF  managemen  t’s  belief  is  that 
NR  LA  would  provide: 

a.  a  more  scientific  approach  to  RLA  and  thus  reduce 
the  RAAF’s  reliance  on  the  individual  analyst's 
experience,  and 

b.  a  means  of  accommodating  SRU/LRU  indenture  when 
allocating  support  equi pme nt  costs  (5:1). 

The  research  process  began  with  the  documentation  of 
existing  RAAF  and  USAF  RLA  procedures.  This  was  achieved  by 
reviewing  orders  and  instructions  on  RLA  and  confirming 
publ  i  shed  information  through  informal  interviews  with  reoair 
level  analysts.  Drawbacks  of  existing  RAAF  procedures  were 
then  determined  through  formal  interviews  with  RAAF  analysts 
and  reviews  of  correspondence  on  previous  RLA  projects. 
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The  next  step  was  to  ascertain  if  NRLA  based  RAAF  RLA 
could  overcome  some  of  the  drawbacks  of  present  RAAF  RLA 
procedures.  NRLA  was  found  to  offer  improvements  over 
existing  methods  of  RAAF  RLA.  Therefore,  the  final  stage  of 
the  research  identified  possible  sources  of  data  to  support 
NRLA  based  RAAF  RLA. 

Cone  I  us i ons 

As  a  result  of  the  research  four  conclusions  can  be 
made.  First,  the  research  confirmed  RAAF  management’s  be! ief 
that  existing  methods  of  RAAF  RLA  do  not  adequately  address 
LRU/SRU  indenture  when  al locating  support  equipment  costs. 

The  belief  that  there  is  a  heavy  reliance  on  individual 
analyst’s  experience  was  also  conf i r med .  Analysts  are  relied 
upon  to : 

a.  identify  where  data  can  be  obtained  to  develop 
standardized  cost  elements,  and 

b.  manipulate  data  from  existing  sources  to  make  it 
suitable  for  developing  standardized  cost  elements. 
Second,  existing  RAAF  RLA  methods  make  it  difficult  and 

time  consuming  to  conduct  any  form  of  sensitivity  ana  I  vs  1  s . 
For  each  variation  from  the  original  case,  the  entire  manual 
RLA  process  has  to  be  repeated,  as  if  a  new  component  was 
being  evaluated. 

Third,  a  NRLA  based  RLA  would  offer  improvements  over 
existing  RAAF  RLA  methods  in  the  areas  of  al locating  support 
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equipment  costs  between  indentured  items,  and  sensitivity 
analysis.  This  is  because: 

a.  RAAF  RLA  requires  the  manual  al location  of  support 
equipment  costs,  with  no  means  of  systematical ly 
accounting  for  SRU/LRU  interdependencies.  In  contrast, 
NRLA  al lows  the  relationships  between  SRU ' s  and  LRU’s  to 
be  modeled  as  a  network.  Support  equipment  costs  are 

au  roma  tically  attributed  to  SRUs  and  LRUs  by  NR LA  on  the 
basis  of  LRU/SRU/SE  i n terdependency .  NRLA  therefore 
provides  a  system-wide  optimal  repair  solution  rather 
than  an  individual  component  solution  as  is  the  case 
with  existing  RAAF  procedures.  This  makes  it 
particularly  useful  for  analyzing  complex  comoonents  or 
sub  assemb I ies;  and 

b.  A  standard  NRLA  output  can  contain  a  spec  i  f  i  c 
solution  and  several  different  sensitivity  analysis  for 
a  complex  component  or  sub  system.  Further  sensitivity 
analysis  and  changes  to  input  data  can  be  accommodated 
by  changing  one  or  two  data  cards. 

Fourth,  although  NRLA  offers  improvements  over  existing 
RAAF  procedures,  it  is  at  a  cost  of  greater  data  dependence. 
The  RAAF  already  has  difficulties  satisfying  data 
requirements  for  existing  RLA  procedures.  NRLA  data 
requirements  are  more  comprehensive  than  RAAF  RLA  data 
requirements  (refer  to  Appendices  A  and  B).  Therefore,  it 
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would  be  more  difficult  to  satisfy  NRLA  data  needs. 


I  f  NRLA 


was  introduced  to  the  RAAF  using  current  data  col  lection  and 
cost  estimation  procedures,  there  would  be  gr eater  rather 
than  I  ess  rel  iance  on  the  experience  of  individual  analysts. 
This  is  because  the  comprehensive  data  input  requirements  of 
NRLA  would  require  more  effort  and  expertise  by  the  analysts 
to  identify,  col lect,  and  manipulate  data  for  input  cost 
est imat i on . 

If  current  data  col  lection  and  cost  estimation 
procedures  could  be  improved,  the  existing  RAAF  RLA  procedure 
would  be  suitable  for  simple  components,  and  a  NRLA  based  RLA 
could  be  used  to  effectively  analyze  complex  components,  or 
sub  systems. 

Re commend a  t i ons 

This  research  has  establ  ished  that  RAAF  RLA  requires 
i mpr ovemen ts ,  and  that  NRLA  can  provide  some  of  those 
improvements.  However,  regardless  of  which  RLA  procedure  the 
RAAF  uses,  data  col  lection  is  a  major  constraint.  To  address 
data  collection  difficulties  and  the  introduction  of  NRLA  it 
is  recommended  that: 

a.  Data  sources  for  existing  RAAF  RLA  and  NRLA  based 
RLA  be  identified  and  documented.  Table  1  in  chapter  IV 
details  possible  sources  of  data  for  existing  RAAF  and 
NRLA  based  RLA.  However,  further  investigation  is 


6  7 


r equ i red  , 


b.  Data  sources  be  required  to  produce  data  in  an 
acceptable  form  for  RLA  input.  USDoD  LSA  data 

r  <-  -|u  i  rements  may  provide  a  useful  reference  to  develop 
the  proper  data  elements  for  RLA  cost  elements, 

c.  Only  after  appropriate  data  sources  and  data  formats 
are  ava i I ab I e  should  NRLA  be  introduced  to  the  RAAF ,  and 

d.  NRLA’s  use  in  the  RAAF  should  be  I imited  to  the 
analysis  of  complex  components  or  sub  systems  where  it’s 
strength  in  allocating  support  equi pmen  t  costs  and 
sensitivity  analysis  will  contribute  to  a  better  quality 
RLA .  With  improved  data  collection  procedures,  existing 
RAAF  RLA  methods  should  be  preferred  for  the  analysis  of 
simple  components. 

It  is  the  author's  studied  opinion  that  the  use  of  NRLA 
can  improve  the  effectiveness  of  RAAF  RLA  in  the  analysis  of 
complex  components  and  sub  systems.  However,  before  NRLA  can 
be  introduced  to  the  RAAF  data  col  lection  and  cost  estimation 
problems  must  be  addressed. 
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1  .  Weapon  System  Data 


a .  End  i tern  name . 

b.  Number  of  bases. 

c.  Fraction  of  number  of  systems  deployed  overseas. 

d.  Operational  life  of  system  in  years. 

e.  Number  of  systems  at  each  base. 

f.  Operating  hours  per  month. 

g.  Cost  of  developing  support  equipment  for  the  system 
(in  $  1 000)  . 

h.  Type  of  sensitivity  analysis  required. 

i.  Range  information  for  sensitivity  analysis. 

2.  Maintenance  System  Data 

a .  Available  work  t ime  per  mon  th  for  an  intermediate 
maintenance  man  (manhours/month) . 

b.  Hourly  rate  for  intermediate  level  maintenance  man 
( $ / hour  )  . 

c.  Ava i I ab I e  work  time  per  month  for  a  deoot  level 
maintenance  man  (manhours/month) . 

d.  Hourly  rate  for  depot  level  maintenance  men 
( $ / hou r )  . 


G  . 

Annua  1 

turnover 

rate 

a  t 

i n  t e  r med  i a  t e 

f  . 

Annua  1 

tu  r  no ver 

rate 

a  t 

depot  level  . 
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3.  Supply  System  Data 

a.  Initial  management  cost  to  introduce  a  new  item  to 
the  inventory  system. 

b.  Recurring  management  cost  to  maintain  an  item  in 
the  wholesale  inventory  system. 

c.  Annual  management  cost  to  maintain  an  item  in  the 
base  level  supply  system  ($/ item/year). 

d.  Time  between  initial  order  for  an  item  and  the 
receipt  of  that  item  at  a  continental  base 
(months) . 

e.  Time  between  initial  order  for  an  item  and  the 
receipt  of  that  item  at  an  overe^as  base. 

f.  Cost  of  packing  for  shipment  to  continental  bases 
(  $ / pou  nd )  . 

g.  Cost  of  packing  for  shipment  to  overseas  bases 
( $ / pou nd )  . 

h.  Ratio  of  packed  weight  to  item  weight  for 
continental  shipments. 

i.  Ratio  of  packed  weight  to  item  weight  for  overseas 
sh i pmen  ts . 

j.  Shipping  rate  to  continental  locations  (t/pound!  . 

k.  Shipping  rate  to  overseas  locations  ($/pounc)  . 


7  0 


Cost  per  original  page  of  technical  data  produced 


by  the  contractor  to  support  item  repairs  ($/page) . 
(Note:  does  not  include  reproduction  and 
distribution  costs). 

Support  Equipment  Data 

a.  Support  equipment  identification  number  that 
identifies  the  general  category  that  the  suoport 
equipment  fa  I  Is  into. 

b.  Support  equipment  name. 

c.  Cost  per  unit  of  the  support  equi pm a nt  (i/un i t) . 

d.  Annual  maintenance  and  operating  costs  to  support 
one  unit  of  the  support  equipment  (i/year) . 

e.  Number  of  existing  units  of  suopor  t  equipment  per 
location  (for  common  support  equi pmen  t  only). 

f.  Average  in-use  time  for  each  of  the  existing 
support  equipment  units  (hours/month) . 

g.  Expected  time  that  a  unit  of  support  equipment  w  I 
be  available  for  i  tern  repairs  ( hours/mon  th)  . 

h .  Cost  of  new  facilities  or  enviro  nme  nta l  controls 
required  for  the  support  equi pme n  t  ( $ )  . 

Line  Replaceable  Unit  (LRU)  data 

a .  LRU  identifier. 

b .  LRU  name . 

c.  Number  of  LRUs  per  end  item. 


Cost  of  one  unit  of  the  LRU  ('t/unit). 


e.  Weight  of  the  LRU  (pounds) . 

f.  Ratio  of  end  LRU  operating  hours  to  end  i tom 
operating  hours. 

g.  Elapsed  time  between  removal  of  a  fai led  LRU  at  a 
continental  base  until  that  item  could  become  a 
serviceable  spare  in  decot  stock  (month) . 

h.  Elapsed  time  between  r emova I  of  a  failed  LRU  at  an 
overseas  base  until  that  item  could  become  a 
serviceable  spare  in  depot  stock  (months) . 

i  .  Elapsed  t i me  between  r  emova l  of  a  failed  lRU  at  a 
base  until  it  could  become  a  serviceable  scare  in 
base  stock  (months) . 

j.  Fraction  of  LRU  failures  that  could  be  r  e  o  a  ■  r  e  d  at 
the  organizational  level  (on  equioment 

ma intenance) . 

k.  Total  number  of  kinds  of  general  purpose  succct 
equipment  resources  required  at  both  depot  and 
intermediate  level  for  LRU  repair. 

I  .  Mean  t  i  me  be  tween  failures  for  the  LRU1  in  its 
operating  environment. 

6.  LRU  Fai lure  Mode  Data 

a.  LRU  identifier. 

b .  Failure  mod e  identifier  (different  number  for  e a  ■  n 
type  of  failure). 
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c.  Frequency  of  th;s  type  of  failure  (from  b.)  as  a 
fraction  of  all  failures  for  an  LRU. 

d.  SRU  identifier  for  the  SRU  associated  with  the 
specified  LRU  ai lure  mode . 

e .  SRU  name . 

f.  Number  of  new  oar ts  or  assemb i ; es  required  for  tne 
r  e  pa i r  . 

g.  Number  or  standard  parts  (  i  .  e  m)  parts  already  in  tne 
inventory  system)  required  tor  the  base  inventory 
if  the  LRU  is  base  repairej. 

h.  Cost  of  al I  non-r epar ab I e  assemb I les  and  parts 
required  for  repair  of  specified  fai'ure  mode  ( 5 ) 

i.  Weight  of  non  reparable  Pc.rts  required  (pounds). 

j.  Minimum  number  of  depot  maintenance  personnel  to  be 
trained  for  repair  task  (optional  entry). 

k.  Minimum  number  o'  base  maintenance  personnel  to  ce 
trained  for  repair  task  (optional  entry). 

I  Number  of  maini’enancu  marhoui  s  required  for  depot 

I  eve  I  repa  i  r  (manhours/  i  tern)  . 

m.  Number  of  maintenance  manhours  required  for  base 
eve  I  repair  (manhour i  temi  . 

n  .  Maintenance  *•  r  a  n  i  n  g  time  r  e  q  u  i  r  e  d  to  t  e  a  c  n  tne 
n  k I  j  for  repair  (weeks )  . 

o.  Ma*‘Pr‘.a!  and  instruction  costs  tor  tne  r  e  a  e  c 

t  r  a  i n  n  g  < % / we  e  k / p o  r  s  u n )  . 


p.  Number  of  pages  of  technical  data  required  for  the 
repair  task  ( pages/ r e pa i r ) . 

q.  Total  number  of  special  support  equipment  resources 
r  equ  i  r  ed . 

r.  Forced  LRU  fai lure  mode  decision  (optional  al lows 
compar isons  to  be  made) . 

s.  Number  of  hours  the  support  equipment  is  required 
to  aid  in  the  repair  of  the  specified  failure  mode 
(hours/repair) . 

7.  Shop  Replaceable  Unit  (SRU)  Data 

a.  SRU  identifier. 

b.  Unit  cost  of  SRU  (4/unit). 

c.  Weight  of  SRU  (pounds/SRU) . 

d.  Cost  of  parts  and  assemb l ies  used  in  SRU  repair 
( $ / SRU  repair). 


e  . 

We  i  gh  t 

o  f 

parts  and 

assemb lies 

used  in  repai 

r 

(pounds 

)  . 

f  . 

Number 

o  f 

new  par  ts 

and  assemb 

lies  used  ( No  . 

/SRU 

repair) 

g  ■ 

Number 

o  f 

s  tandard 

par  ts  r  equ  i 

red  for  repair 

o  f 

SRU  . 

h  . 

Number 

o  f 

technical 

pages  requ 

ired  for  repai 

r 

i  , 

Number 

o  f 

kinds  of 

support  equ 

ipment  resources  used 
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t  n  r  e  pa  i r  . 


j  .  Elapsed  t i me  between  r  emova I  of  failed  SRU  fr  om  an 
LRU  at  a  continental  base  unti I  it  repaired  and 
ready  to  be  shipped  (months) . 

k  .  Elapsed  ti me  be  twe  e  n  r  emova I  of  failed  SRU  from  an 
LRU  at  an  overseas  base  until  it  repaired  and  ready 
to  be  shipped  (months) . 

I  .  Elapsed  t  i me  be  tween  r  emova I  of  failed  SRU  from  an 
LRU  at  a  base  until  i  c  repaired  at  the  base  and 
ready  for  use  (months) . 

m .  T  i  me  required  to  repair  at  depot  (hours). 

n.  Time  required  to  repair  at  base  (hours). 

o.  Number  of  persons  to  be  trained  at  depot  to  repair 
SRU  (optional). 

p.  Number  of  persons  to  be  trained  at  base  to  repair 
SRU  (optional) . 

q.  Time  taken  to  train  repairman  (weeks) . 

r.  Material  and  Instruction  costs  to  train  repairman 
( $ / per son/week ) . 

s.  Forced  SRU  decisions  (see  item  6 -r  on  forced  LRU 
decisions) . 

t.  Number  of  hours  of  support  equipment  renuired  to 
repair  SRU  (hours/repair) . 

8.  LRU/SRU/SE  Cross  Reference  Table 

The  purpose  of  this  data  record  is  to  specify  the 
relationship  between  the  svstem  LRUs,  SRUs  and  support 
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equipment.  This  is  achieved  by  cross  referencing  LRU  and  SRU 
system  identifiers  entered  in  earlier  records,  and  matching 
them  with  failure  modes  and  support  equipment  resource 
numbers,  also  entered  earl  ier. 

Adapted  from  3:15-25 


E 
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Appendix  B:  RAAF  RLA  Cost  Elements 


Cost 

E 1 emen  t 

Initial  Cost 

Cons iderat ions 

Fo 1 1 ow  on  Cost 

Cons  i  derat i ons 

1  . 

Ma i ntenance 

Pub  1  i cat i ons 

Se lection 
.  Va 1  i  dat i on 
.  Purchas i ng 
.  Ca  ta 1 ogu i ng 
.  Manpower 

.  Conf igurat ion 

Ame ndme n  ts 
Manpower 

2  . 

Training 

Finite 

Finite 

3  . 

Ma  i  ntenance 
Manpower 

.  Neg 1 i g i b 1 e 

.  Finite 

4  . 

Support 

Egu i pmen  t 

.  Se 1 ec  t ion 
.  Pu  r  c  has i ng 
.  Distribution 

Instal lation 
.  Testing 

.  Maintenance  cost 
i nc 1 ud i ng 

Cal ibration  and 

contractor 

su ppor  t 

5  . 

Tool i ng 

.  Selection 
.  Purchas i ng 

.  Ma i ntenance 
Wastage 

6  . 

Spares 

.  Selection 
.  Data  Gather i ng 
.  Pu  r  c  has i ng 
.  Compu  tat  ion 

Wastage 
.  Storage 
.  DiStr ibution 

Tr  aocnnr  '  C  ^ 

7  . 

Co  nsumab 1 e 

Repa i r  Par  ts 

.  Selection 
.  Pur  chas i ng 
.  Compu  tat i on 
.  Order i ng 
.  Management  Coding 
.  Life  of  Type  ? 

.  Rep  1 en  i shmen  t 
.  Holding  Costs 
.  Depreciation 

8  . 

So  f  twar  e 

.  Se 1 ec  t  i  on 
.  Pur  chas i ng 

Con  f  i  gur  a  t  i  on 
Managemen  t 
.  Ma i n  tenance 

9  . 

Fac i 1 i t i es 

.  Space  Allocation 
Propor  t  i  on 
.  Finite  Cost 

Ma i ntenance 

F  i  n i  te  Cos  t 

10.  Transportation 
Packag i ng  and 
Hand  I  i ng 


Transporvat  ion 
cos  ts  for 
ma i ntenance 


Finite  Cos  t 


1 1  . 

Standardization 

.  Effort  to 

Standard i ze 

1  2  . 

Data  Processing 

.  Cost  of  project 

Suppor  t 

suppor  t 

1  3  . 

1 nven  tor  y 

1  tern  entry 

Management 

con  tr  o 1 

1  4  . 

Eng i near  i  ng 
Manageme  n  t 

Finite 

Source:  18:6213H2 

Suppor  t  of 
Standard  I  terns 

Cost  of  on  go i ng 
data  maintenance 
Large  and  Finite 

Finite 

Disposal  costs 
Finite 
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Appendix  C:  CAPPRQJ  R[_A  Cost  Compar  is  on  Chart 


f 

Cost  E 1 emen  ts 

(refer 

append i x  B) 

L 

0  i  card  1 

1 

Depot 

Inter 

Oper 

Over- 

Levs  1 

Leve  1 

Leve  1 

Leve  i 

Seas 

NR  |  R 

NR  1  R 

NR  |  R 

NR  1  R 

NR  I  R 

t  r  ac  1 1 


Ma i ntenance 
Pu b I  i cat  ion 

Training 

Ma i ntenance 
Manpower 

Support 
Eq  u  i pme  n  t 

Tool  i  ng 

Spares 

Consumab I e 


1 

| 

1  K  1  1  *  cai  i.  to 

l 

1 

i  8. 

So  f  twar e 

j 

9  . 

1 

Fac i 1 i t i es 

I 

i  10 

1 

.  T  ransDor  t 

1 

i 

1 

1 

Packag i ng  an 
Fland  1  i  ng 

!  11. 

1 

Standards 

!  12. 

i 

| 

Da ta  Process 

1 

Supoor  t 

! 

i 

! 

I 

1 

i 

1  3  . 

1 

1  nven  tor  y  1 

Management  ! 

1 

i 

1  1  4  . 

i 

i 

Eng i neer i nq 
Managemen  t 

TOTALS 

TOTAL  LIFE 
CYCLE  COSTS 


Source  ( 1 8 : 6  2  I  3  J 1  ) 


Appendix  D:  CAPPROJ  RLA  Reco r d 


Page  1  o 

This  certificate  records  the  CrthHOJ  RLA  solution  at 

Project  Transition  within  the  Project  . 

.  for  TMP  reference  . 

Overview  Conclusion  Project  Officer  Comn? 

Cons i d er a t i on  has  been  given  to 
life  cycle  costing  and 
strategic  imp  I  ications. 


Maintenance  levels  (including 
repair  levels)  and  allocations 
uf  maintenance  activities  to 
venues  appear  consistent  with 
tne  manufacturer’s 
r  ecommenda t ions. 


Tne  maintenance  do  I  icy  is/  is 
not  based  more  on  strategic 
considerations  than  economic 
factors . 


The  maintenance  po I  icy  is/ is 
not  based  on  management  cf 
S i m M  a  r  it  ems  already  ' n 
service. 


03  te  cAPPOJ  Pr o | ec  t  0 f  f  :  c 


30 


Technical  Management  Code 


True  Mfr  Name 


NHA  Reference  No 


tern  Name 


True  Mfr  Reference  No 


True  Mfr  Code!  6.  QTY/End  I  tern 


7 .  Price 


8.  Construction 


Unit  Cost  Break  QTY  Unit  Cost  Modular 

at  Break 


n  tegr a 


9  . 


System 


I  tern  Code 


LRU  Module/Part 


10.  Expected  Lives 


MTBUR 


MTBSRI 


Inter 

Depo  t / Con  t 

H  • 

1  3  . 

I 

SMR  Code 

Condemnation  Factor 


REP/OH 


5.  I  tern  Description: 


16.  Description  of  Maintenance  to  be  accomplished: 


Page  3  of  3 


17.  RAAF  Maintenance  concept  which  guides  maintenance 
po i icy  formulation: 


18.  RAAF  maintenance  po  I  icy  to  which  spares  assessing 
began : 


19.  RAAF  maintenance  policy  at  Project  Transition: 


20  . 

Confidence  in  cost  factors  accuracy  for  RLA: 

i 

i 

2  1  . 

Explanation  of  strategic 
an  Economic  Solution  (if 

factors  causing  override  of 
any )  : 

! 

' 

1 

1 

i 

i 

22  . 

Additional  RLA  reference 

Material: 

1 

i 

i 

| 

1 

Enclosures:  1.  CAPRO J  RLA  Cost  Compar ison 

2.  PATTRIC  Print  out  (if  applicable) 


Sour  ce :  18:621 3G 1 
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Appendix  E : 


1  .  Wing  Commander  S.  Lang,  3 AD  ( former  I y  of  CAPROJ ) , 

Author  of  Headquarters  Support  Command  Logistic  Branch 
Instructions  on  Repair  Level  Analysis. 

2.  Squadron  Leader  K.  Henderson,  HQSC-A I RENG2  (formerly  of 
CAPROJ) ,  manager  of  the  RLA  team  for  the  B I ackHawk  and 
Squirrel  projects. 

3.  Flight  Lieutenant  G.  Breen,  DM P-AF,  responsible  for 
reviewing  BlackHawk  repair  policy  at  the  Headquarters 
Defence  Force  Level . 

4.  Warrant  Officer  W .  Sparr ow  (CAPROJ) ,  repair  level 
analyst  on  the  BlackHawk  project. 

5.  Sergeant  P.  Walde  rCAPROJ) ,  repair  level  analyst  on  the 
B I ackHawk  project. 

6.  Sergeant  P.  Rackley  (CAPROJ) .  repair  i eve i  analyst  on 
the  BlackHawk  project. 

7.  Corporal  S.  O’Donoghue  (CAPROJ)  repair  level  analyst  on 
the  BlackHawk  project. 


Appendix  F :  Initial  interview  Questions 


Introductory  Remarks. 

He  I  lo  I  am  Squadron  Leader  John  Ecke  I  ,  I  am  cal  I  i  ng  from 
the  USA  where  I  am  doing  the  graduate  logistics  course.  For 
my  thesis  I  am  investigating  repair  level  analysis  procedures 
for  the  RAAF .  I  understand  that  you  are  (have  been)  involved 
in  RLA  and  wonuer  if  I  can  take  some  of  your  time  to  answer 
some  questions  about  the  way  RAAF  does  RLA?  I  will  be 
talking  to  a  number  of  people  involved  in  RLA  and  wh i I e  I 
will  list  you  as  a  respondent  I  will  not  attribute  any 
comments  directly  to  you.  Under  these  conditions  would  you 
object  if  I  recorded  this  conversation  so  as  I  do  not  have  to 
take  notes  wh i le  talking? 


Part  1  -  Procedural  Questions 


The  first  set  of  questions  I  will  ask  you  deals  w :  t h  the 
procedures  and  guidel i nes  for  RAAF  RLA  as  publ ished  /n 
Support  Command  Logistics  Instructions.  My  purpose  ,s  to  see 
if  guidelines  are  foil  owed  in  practice,  and  to  fill  in  some 
of  the  gaps  left  by  the  instructions. 

1.  The  first  stage  in  the  RAAF  RLA  process  involves 
determining  if  an  item  is  mtr insicly  reoairaoie.  mow 
do  you  decide  it  an  item  is  repairable  or  not’ 

2.  Certain  Costs  must  be  gathered  to  perform  RlA,  now  du 
you  gather  these  costs? 

3.  If  for  some  reason  accurate  cost  data  for  RLA 
calculations  can  not  be  obtained,  how  do  you  resolve  the 
ma  t  ter  ? 

4.  If  an  overseas  Service  has  already  determined  a  repair 
po I  icy  for  a  component  being  considered  bv  the  RAAF,  how 
does  this  influence  the  RLA  process7 

5.  How  do  you  modify  an  overseas  maintenance  policy  to  meet 
RAAF  requirements7 


Par  t  2  -  Opinio  ns  of  Present  Methods 

The  purpose  of  the  next  set  of  questions  is  to  qet  vour 
opinion  on  the  procedures  that  are  used  for  RAAF  RLA.  Again 


I  remind  you  comments  will  not  be  attributed  directly  to  you . 
For  each  question  I  want  you  to  give  me  your  general 
impression  (e.g.  not  satisfactory,  satisfactory,  very 
satisfactory) .  From  there  we  will  discuss  the  reasons  behind 
your  response . 

1.  How  would  you  describe  the  present  methods  of  gathering 
cost  element  data  for  the  RLA  process? 

1  2  3 

No:  satisfactory  Satisfactory  Very  satisfactory 

Comme n  ts : 


2.  In  particular,  how  wou Id  you  describe  the  present  me  t  h od 
of  allocating  support  equipment  costs  to  components'7 

1  2  3 

Not  satisfactory  Satis  factory  Very  satisfactory 

Comments : 


3.  How  would  you  describe  the  oresent  method  of  conducting 
sensitivity  analysis'7 


1 

Not  satisfactory 
Comme  n  t  s : 


2 

Sat  is  factory 


3 

Very  satisfactory 


4 .  How  wou Id  you  descr  ibe  your  discussions  with  DMP- AF  wnen 
you  are  trying  to  resolve  data  collection  inadequacies 
( i f  any)  in  the  RLA  process? 

1  2  3 

Not  satisfactory  Satisfactory  Very  sat ' sfactory 


Commen  ts : 
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5 .  How  wo  uld  you  describe  the  present  me  thod  of  c  ompar  i ng 
I ife  cycle  costs  for  repair  alternatives? 

1  2  3 

Not  satisfactory  Satisfactory  Very  satisfactory 

Commen  ts : 


6.  How  would  you  describe  your  discussions  with  DMP-AF 
staff  when  draft  maintenance  policies  are  being 
r  e v i ewed  ? 


1 

Not  satisfactory 
Commen  ts : 


C. 

Sa  t isfactorv 


3 

Very  satisfactory 


7.  How  would  you  describe  the  procedures  for  rina!  icing 
maintenance  po I  icy  in  a  TMP? 

1  2  3 

Not  satisfactory  Satisfactory  Very  satisfactory 

Comme n  ts : 


Part  3  -  Scientific  Rigor  of  RLA  Procedures 

I  want  to  finish  off  the  i nterv i ew  oy  asking  y  c u  some 
Questions  about  the  experience  required  of  an  individual  t 
successful ly  oerform  RLA  in  the  RAAF . 

1.  How  important  is  it  that  someone  with  tne  right 
background  does  RLA? 

1  2  3 

Not  Important  Important  Very  important 


Commen  ts : 


86 


2  . 


What  would  be  the  impact  of  an  inexperienced  individual 
per  form i ng  RLA? 


1 

Neg I i g i b I e 


2  3 

Minor  Problem  Major  Problem 


Comments : 


Cone  I ud i ng  Remarks 

Thankyou  for  your  co-operation,  if  you  are  interebtea  in 
the  find, ngs  of  my  thesis  please  contact  me  at  DMP-AF  (MP1A) 
any  time  after  November  1989. 
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Appendix  G:  Final  Interview  Questions 


Introductory  Remarks. 

Hello  I  am  Squadron  Leader  John  Eckel ,  I  am  calling  from 
the  USA  where  I  am  doing  the  graduate  logistics  course.  For 
my  thesis  I  am  investigating  repair  level  analysis  procedures 
for  the  RAAF .  I  understand  that  you  are  (have  been)  involved 
in  RLA  and  wonder  if  I  can  take  some  of  your  time  to  answer 
some  questions  about  the  way  RAAF  does  RLA?  I  will  be 
talking  to  a  number  of  people  involved  in  RLA  and  wh i !e  I 
will  list  you  as  a  respondent  I  will  not  attribute  any 
comments  directly  to  you.  Under  these  conditions  would  you 
object  if  I  recorded  this  conversation  so  as  I  do  not  have  to 
take  notes  wh i le  talking? 

Part  1  -  Procedural  Questions 

The  f ' r ^ t  set  of  questions  I  will  ask  you  deals  with  the 
procedures  and  guidel  i nes  for  RAAF  RLA  as  publ  i shed  in 
Support  Command  Logistics  Instructions.  My  purpose  is  to  see 
if  guidelines  are  foil  owed  in  practice,  and  to  fill  in  some 
of  the  gaps  left  by  the  instructions. 

1.  The  first  stage  in  the  RAAF  RLA  process  involves 
determining  if  an  item  is  intrinsicly  repairable.  How 
do  you  decide  if  an  item  is  repairable  or  not7 

2.  Certain  Costs  must  be  gathered  to  perform  RLA,  how  do 
you  gather  these  costs? 

3.  If  for  some  reason  accurate  cost  data  for  RLA 
calculations  can  not  be  obtained,  how  do  you  resolve  the 
ma  t  ter  7 

4.  If  an  overseas  Service  has  already  determined  a  repair 
po I  icy  for  a  component  being  considered  by  the  RAAF,  how 
does  this  influence  the  RLA  process? 

5.  How  do  you  modify  an  overseas  repair  po I  icy  to  meet  RAAF 
r equ i r ements? 

Part  2  -  Opinions  of  Present  Methods 

The  purpose  of  the  next  set  of  questions  is  to  get  your 
opinion  on  the  procedures  that  are  used  for  RAAF  RLA.  Again 
I  r em i nd  you  commen ts  will  not  be  attributed  directly  to  you. 
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For  each  question  I  want  you  to  give  me  your  general 
impression  (e.g.  not  sa t i s f ac tor y ,  satisfactory).  From  there 
we  wi  I  I  discuss  the  reasons  behind  your  response. 

1.  How  would  you  describe  the  present  methods  of  gathering 
cost  element  data  for  the  RLA  process? 


1 

Not  Satisfactory 
Comments : 


2 

Sat i s  f  ac  tor  y 


2.  In  particular,  how  would  you  describe  the  present  method 
of  al  locating  support  equipment  costs  to  components? 

1  2 

Not  satisfactory  Satisfactory 

Comments : 


3.  How  would  you  describe  the 
sensitivity  analysis? 

1 

Not  satisfactory 
Commen  ts : 


present  method  of  conducting 

2 

Sat isfactory 


4.  How  would  you  describe  your  discussions  with  DMP-AF  when 
you  are  trying  to  resolve  data  col  lection  inadequacies 
(if  any)  in  the  RLA  process? 

1  2 

Not  satisfactory  Satisfactory 

Commen  ts : 
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5.  How  would  you  describe  the  machanics  of  completing  the 
RLA  process  once  cost  data  has  been  col lected? 

1  2 

Not  satisfactory  Satisfactory 

Corrmen  ts  : 


6.  How  would  you  describe  your  discussions  with  DMP-AF 
staff  when  draft  maintenance  po I i c i es  are  being 
r  ev i ewed  ? 

1  2 

Not  satisfactory  Satisfactory 

Comments : 


Part  3  -  Scientific  Rigor  of  RLA  Procedures 

I  want  to  finish  off  the  interview  by  asking  you  some 
questions  about  the  experience  required  of  an  individual  to 
successful ly  perform  RLA  in  the  RAAF . 

1  .  How  i mpor  tant  is  it  that  someone  with  the  right 
background  does  RLA? 

1  2 
Not  Important  Important 

Commen ts : 


Concluding  Remarks 

Thank  you  for  your  co-operation,  if  you  are  interested 
in  the  findings  of  my  thesis  please  contact  me  at  DMP-AF 
( MP 1 A )  any  time  after  November  1909. 
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Append i x  H :  Detai led  Interview  Responses 

Detai led  responses  to  the  questionnaire  contained  in 
Appendix  G  are  shown  below.  The  responses  quoted  are  largely 
in  the  words  of  the  respondents,  only  minor  amendments  have 
been  made  to  improve  the  readabi  I  i ty  of  the  comments.  Where 
two  or  more  individuals  made  the  same  response  to  a  question 
only  a  single  representative  quote  has  been  listed. 

Editorial  comments  have  been  included  in  parentheses  []. 

Part  1  -  Procedural  Questions 

1.  The  first  stage  in  the  RAAF  RLA  process  involves 
determining  if  an  i tern  is  intrinsically  repairable.  How 
do  you  decide  if  an  item  is  repairable  or  rot1 

"Wei  I  it  is  pretty  much  common  sense,  something  I  ike  an 
aircraft  bolt  is  obviously  not  repairable." 

"For  most  components  it  is  obvious  if  something  can  be 
repaired  or  net,  for  example  an  aircraft  windscreen  is  either 
serviceable  or  not,  you  cannot  ’repair’  a  crazed  windscreen." 

"Usually  you  can  use  common  sense  to  decide  if  some  thing 
is  repairable  or  not.  However,  in  some  instances,  especial  ly 
where  we  think  a  part  would  require  a  lot  of  infrastructure 
or  special ist  test  equipment  support,  we  look  at  what  the  USA 
has  decided.  The  US  military  have  SMR  codes  that  can  tell 
you  if  an  item  is  to  be  ’repaired  on  failure’  or  discarded. 

If  the  US  have  annotated  an  item  as  ’discard’  then  its  I ikely 
development  of  support  equipment  and  infrastructure  is  too 
costly  and  we  wou Id  probably  adopt  a  ’discard  on  failure’ 
policy  too .  " 

"I  am  not  sure  I  understand  your  question,  its  usually 
obvious  if  a  component  is  repairable  or  not.  In  fact,  most 
times  I  think  you  decide  on  that  almost  subconsc i ent iousl y . " 

2.  Certain  costs  must  be  gathered  to  perform  RLA,  how  do 
you  gather  these  costs? 

"in  the  BlackHawk  case  we  first  gathered  cost  data 
individually.  Then  after  some  t i me  we  had  a  meet i ng  and  we  n  t 
through  each  of  the  elements  and  decided  through  group 
discussion  what  the  value  of  each  of  rhe  elements  was  going 
to  be  for  the  BlackHawk  RLA.” 
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"We  were  lucky  that  some  people  in  the  section  had  been 
posted  in  from  SORO  (Staff  Officer  Repair  and  Overhaul]  and 
other  areas  of  HQSC ,  they  knew  where  to  go  to  find  some  of 
the  cost  data  we  needed  or  at  least  provide  an  educated  guess 
of  costs  if  the  data  was  not  available." 

"We  al I  had  a  go  at  trying  to  determine  cost  elements 
and  then  met  as  a  group  to  arrive  at  a  consensus  cost  for 
each  element.  There  are  no  actual  instructions  on  where  to 
go  to  get  cost  element  data. 

"Some  of  us  had  contacts  in  SORO,  others  knew  where  to 
go  in  SO PUBS  (Staff  Officer  Publications];  we  all  did  our 
best  to  track  down  the  cost  data  and  then  met  as  a  group  to 
determine  final  cost  element  values  before  completing  the  RLA 
on  the  BlackHawk." 

"During  the  BlackHawk  RLA  we  gained  access  tu  LSA  data 
prepared  for  the  US  military.  The  LSA  data  filled  in  some 
of  the  gaps  as  far  as  cost  data  was  concerned,  but  we  had  to 
be  wary  of  using  it.  For  example,  USDoD  publ ication  costs 
usual  ly  include  the  cost  of  initial  development  and 
production.  The  cost  to  the  RAAF  would  not  include  any 
development  costs,  but  would  include  costs  of  changes  in  the 
publ ications  to  meet  RAAF  maintenance  practices. 

3.  If  for  some  reason  accurate  cost  data  for  RLA 

calculations  can  not  be  obtained,  how  do  you  resolve  the 

matter  ? 

"Having  accurate  cost  data  was  a  problem. .  We  used 
meetings  between  analysts  to  try  an  determine  ’consensus’ 
values  for  cost  elements...  We  sorted  out  cost  data  problems 
within  the  Capital  Project  area." 

"Determining  the  value  cost  elements  was  done  with 
Capital  Projects,  any  problems  were  resolved  by  us  [CAPROJ] . 
DMP-AF  have  the  opportunity  to  question  our  choice  of  costs 
when  they  review  the  recommended  RLA  decision  from  HQSC." 

"I  (DMP-AF  r epr esen ta t i ve ]  have  had  trouble  sometimes 
trying  to  work  out  how  they  (CAPROJ]  have  determined  some 
cost  element  values  and  expected  number  of  ar i s i ngs .  We 
usual ly  do  not  hear  from  CAPPROJ  unti I  thoy  provide  their  RLA 
recommendation  ana  supporting  documentation. " 

"We  usual ly  sorted  out  any  data  problems  we  had  in- 
house.  Accuracy  was  sometimes  a  problem  in  terms  of  having 
the  right  sort  of  data  on  which  to  base  cost  element 
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estimates.  The  matter  was  resolved  by  developing  a  consensus 
value  for  cost  elements  through  group  meetings." 


4.  If  an  overseas  Service  has  already  determined  a  repair 

po I  icy  for  a  component  being  considered  by  the  RAAF ,  how 
does  this  influence  the  RLA  process? 

"We  have  a  close  look  at  what  overseas  Services  have 
done.  In  particular,  we  make  use  of  LSA  data  that  is 
available  f r om  the  US  military." 

"Although  Overseas  experience  is  a  useful  starting 
po i nL ,  it  is  unwise  to  apoly  it  directly  to  Australia.  Full 
costing  of  each  alternative  should  still  be  conducted  to 
determine  the  most  economical  approach  from  the  RAAF  point  of 
view.  For  instance,  a  component  that  is  repaired  at  a  depot 
in  the  USA  may  be  more  economical  to  repair  at  an 
i n  termed i a  t e  workshop  in  Australia,  or  alternatively  the  1 ow 
number  of  arisings  in  Austral ia  may  make  it  more  economical 
to  send  components  to  the  USA  for  repair." 

"Overseas  policy  has  an  impact  in  two  areas.  First  if 
they  have  decided  that  a  component  should  be  discarded  on 
failure  because  of  low  replacement  cost  but  high  servicing 
cost  then  we  most  likely  will  adopt  the  same  po I  icy.  Second, 
the  data  used  to  arrive  at  an  overseas  repair  po l icy  may  be 
useful  in  determining  a  RAAF  ma intenance  pol icy. 


5.  How  do  you  modify  an  overseas  repair  pol icy  to  meet  RAAF 
r  egu i r  emen  ts  ? 

"As  I  have  mentioned,  we  sometimes  take  LSA  data  from 
the  US  military,  make  sure  the  costs  relate  to  the  RAAF ,  o r 
modify  the  costs  so  that  they  do,  and  then  use  that  data  in 
part  of  the  RLA  calculations  [see  response  Part  1  question 
2]  .  " 


"We  do  not  actually  mod ify  policy,  it  is  mo  re  like 
taking  the  information  [data]  they  used  to  arrive  at  their 
policy  and  mod ifying  it  to  suit  our  analysis." 

"This  question  seems  similar  to  the  last  one;  I  do  not 
think  we  take  the  overseas  policy  and  mod ify  it,  rather  we 
look  at  how  they  arrived  at  that  decision  (if  we  can  get  the 
data)  and  see  if  that  is  applicable  to  the  RAAF . 


93 


Part  2  -  Opinions  of  Present  Methods 

1.  How  would  you  describe  the  present  methods  of  gathering 

cost  element  data  for  the  RLA  process9 

Not  Satisfactory  -  2  Satisfactory  -  5 

"I  think  you  have  to  be  wary  of  some  of  the  figures  that 
analysts  come  up  with.  Often  we  [RAAF]  have  this  attitude 
that  we  can  do  it  better  and  cheaper  than  other  countries; 
sometimes  this  results  in  costs  and  failure  rate  estimates 
being  too  optimistic." 

"The  method  of  col lecting  and  evaluating  data  for  cost 
elements  is  not  ideal ,  (method  is  described  in  response  to 
Part  1,  question  2],  but  I  think  it's  the  best  and  most 
consistent  way  of  doing  things  under  existing  conditions." 

"I  think  the  procedure  we  used  of  going  out  individually 
to  get  cost  data,  and  then  meeting  as  a  group  to  decide  what 
data  to  use  in  the  RLA  was  a  good  way  of  making  sure  a  I  I 
available  sources  of  data  were  investigated." 

I  was  happy  enough  about  how  we  determined  cost  element 
data,  but  I  would  have  I  iked  to  have  some  sort  of  documented 
procedure  tel  I  i ng  me  where  I  should  go  to  get  the  data  and 
what  form  that  data  should  be  in.  Sometimes  we  could 
identify  where  the  data  should  come  from,  but  they  would  not 
have  kept  details  of  the  in  forma  t i on  we  wan  ted . 

"We  had  meetings  to  try  and  determine  the  right  value 
for  cost  elements  in  the  B I ackHawk  analysis.  We  did  the  best 
we  could,  but  had  some  problems.  For  example,  initial 
publ ication  costs  varied  in  price  depending  on  the  source  of 
the  data.  Inventory  cataloging  costs  had  no  identifiable 
source  at  all.  In  both  cases  a  standardized  ’best  guess’  was 
mad e  because  there  was  not  an  identifiable  reliable  data." 

2.  In  particular,  how  would  you  describe  the  present  method 

of  al locating  support  equipment  costs  to  components? 

Not  sa" isfactory  -  7  Satisfactory  -  0 

"I  do  not  think  we  do  a  good  job  of  allocating  support 
equipment  costs.  For  complex  components  we  are  real ly 
guessing  at  the  al location  of  costs  on  the  basis  of  support 
equipment  usage." 

"Not  only  are  we  having  problems  al locating  costs 
between  components  using  new  support  equipment,  but  we  are 
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having  trouble  al locating  proportional  use  of  existing  ground 
support  equipment  for  new  components." 

"When  we  started  B I ackHawk  RLA  we  used  to  al locate  the 
entire  cost  of  the  support  equipment  to  each  and  every 
component  using  it.  Then  we  got  a  bit  wiser  and  now  attempt 
to  allocate  cost  on  the  basis  of  usage.  This  is  difficult 
though,  especial  ly  when  you  have  a  comp  lex  piece  of  kit  with 
many  sub  components  [LRU/SRU] ,  all  of  which  use  the  same 
piece  of  test  equipment." 

I  am  st ill  not  too  sure  about  how  to  go  about 
allocating  support  equi pme  nt  costs  to  new  compo  ne  n  ts .  If  the 
support  equipment  already  exists,  we  have  to  try  and  work  out 
the  time  it  can  be  used  for  servicing  the  new  component,  if 
there  is  enough  time  ava i lable  to  meet  servicing  needs,  ana 
the  cost  that  should  be  given  to  the  component  for  its  share 
of  support  equipment  use.  If  new  support  equipment  is  to  be 
purchased,  the  cost  of  usage  per  component  serviced  has  to  be 
worked  out  for  RLA  calculations.  Al I  of  this  is  hard  to  do, 
with  the  data  available,  it  is  like  crystal  balling." 


3.  How  would  you  describe  the  present  method  of  conducting 
sensitivity  analysis? 

Not  Satisfactory  -  3  Satisfactory  -  0 

Note:  some  of  the  respondents  were  not  aware  of  the  term 

sensitivity  analysis.  However,  they  did  comment  on 
procedures  emp I oy ed  to  answe r  ’what  if’  type  questions.  AM 
responses  were  noted;  however,  only  those  who  understood  the 
term  sensitivity  analysis  had  their  sa t i s f ac tor y / 
unsatisfactory  responses  recorded. 

"Sensitivity  analysis  was  limited  to  running  variations  on 
the  PATRIC  model  and  crunching  the  numbers  using  the  normal 
RLA  manual  process.  There  were  no  shortcuts,  varying  one 
parameter  still  required  the  whole  RLA  process  to  be 
repeated,  the  same  as  if  we  were  looking  at  a  new  component 
for  the  first  ti me . 

"I  do  not  think  we  do  any  sensitivity  analysis,  at  least 
I  do  not  think  any  one  asked  us  to.  If  we  had  to  answer 
’what  if’  questions  (meaning  of  'what  if’  questions  explained 
by  interviewer) ,  I  think  we  would  have  to  redo  the  analysis 
f r om  scratch. 

I  am  not  sure  that  we  are  doing  sensitivity  analysis 
but  soon  we  wi  I  I  be  redoing  some  major  components  from  the 
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BlackHawk  RLA;  any  changes  in  the  data  for  that  wi  I  I  cause  us 
to  redo  the  entire  analysis  for  the  component  concerned.'' 

"We  [ DMP-AF ]  do  not  normally  task  CAPROJ  with  doing 
sensitivity  analysis,  the  present  RLA  procedures  make  it  vary 
time  consuming  and  we  do  not  think  they  have  the  staff  or 
time  to  handle  it.  For  sensitive  components,  for  example 
allocation  of  B I ackHawk  gearboxes  to  civilian  or  military 
depots,  we  sometimes  try  and  do  an  ’ad  hoc’  form  of 
sensitivity  analysis  here  ( DMP-AF ].  In  recent  t i mes  the  need 
for  sensitivity  analysis  has  increased  as  'what  if’  questions 
about  civil  versus  military  ma intenance  of  ma  jor  components 
are  investigated.” 

"If  sensitivity  analysis  means  adjusting  different 
inputs  to  see  what  the  output  changes  to,  then  we  do  not  do 
that  here  [CAPPROJ] . 

4.  How  would  you  describe  your  discussions  with  DMP-AF  when 
you  are  trying  to  resolve  data  collection  inadequacies 
(if  any)  in  the  RLA  process7 

Not  satisfactory  -  0  Satisfactory  -  6 

Note :  one  of  the  respondents  did  not  answer  this  question  as 
he  had  not  had  any  direct  deal i ngs  with  DMP-AF. 

"Sometimes  they  (DMP-AF]  ask  us  to  look  at  RLA  of 
components  again  in  I ight  of  new  information  on  contractor 
versus  military  support,  especially  if  there  is  some  question 
over  military  versus  civilian  repair  facilities  being 
establ  i  shed .  To  do  this  we  have  to  virtual  ly  redo  the  whole 
RLA  .  '' 


"They  [DMP-AF]  sometimes  question  us  over  the  figures  we 
have  chosen  for  cost  elements  in  RLA  calculations.  But 
usually  after  we  have  provided  additional  information  they 
[DMP-AF]  are  happy  about  what  we  have  done.” 

Every  now  and  then  DMP  question  some  of  the  assumptions 
we  have  used  for  calculating  cost  element  or  fai lure  rate 
figures.  Usually  all  they  want  is  some  mo re  information  on 
why  we  did  what  we  did  and  once  we  supply  that  they  are 
happy . 


"I  do  not  think  we  have  any  problems  with  DMP,  they  ask 
us  for  more  information  and  we  give  it  to  them.” 
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5.  How  would  you  describe  the  mechanics  of  completing  the 

RLA  process  once  cost  data  has  been  col lected? 

Not  satisfactory  -  2  Satisfactory  -  5 

"Once  the  cost  elements  have  been  decided  upon  the 
me chanics  of  calculating  life  cycle  costs  for  the  various 
repair  alternatives  are  pretty  simple.  We  foil ow  the  HQ SC 
instructions  very  closely." 

"HQSC  instructions  are  easy  to  fol i ow  when  calculating 
alternative  repair  costs.  A  DBASER  program  is  used  to 
automate  the  adding  up  of  cost  elements  for  the  different 
repair  alternatives." 

"Recently  we  have  been  asked  to  do  some  'what  ■ f 
calculations  to  do  with  the  8lackHaw<  transmission,  The 
manual  procedures  mean  we  have  to  do  the  r eca I cu I  a t i ons  from 
the  start.  It  is  the  same  amount  cf  work  as  if  we  were 
looking  at  a  new  component.  This  is  not  so  bad  for  simple 
components  where  costs  are  straight  forward,  but  for  complex 
components  or  sub  systems  it  is  a  tedious  process." 

"The  mechanics  of  the  RLA  process,  after  the  cost 
elements  have  been  determined,  are  easy  to  complete. . . .  What 
takes  up  time  is  the  need  to  run  PATRIC  for  each  repair 
alternative  [operational,  depot,  in  termed i ate!  to  get  spares 
requirements  and  cost  data.  Obviously,  the  more  complex  the 
component  or  system,  the  more  time  it  takes." 

"The  problem  with  [RAAFj  RLA  is  not  the  process  that 
occurs  after  the  cost  elements  have  been  determined;  its  with 
getting  those  cost  elements  in  the  first  place.  If  the  data 
problems  could  be  solved,  the  existing  procedures  would  be 
fine  for  determining  RLA  for  simple  components.  More  complex 
compone  n  t s  wou Id  still  be  a  bit  tricky  because  of  the  support 
equipment  cost  problem,  but  simple  components  could  be 
accurately  analyzed. 


6.  How  would  you  describe  your  discussions  with  DMP-AF 
staff  when  draft  maintenance  po I i c i es  are  being 
rev i ewed  ? 

Not  satisfactory  -  0  Satisfactory  -  6 

No  te :  one  of  the  respondents  did  not  answer  this  question  as 
he  had  not  had  any  direct  dealings  with  DMP-AF . 
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"Sometimes  there  is  a  bit  of  discussion  regarding  the 
way  we  determined  some  cost  element  figures,  but  this  is 
usually  sorted  out  am i cab  I y . 

"The  review  u  f  draft  maintenance  po I icies  is  usual ly  the 
only  time  we  talk  to  DMP  about  RLA  other  then  the  original 
RLA  specifications  they  pr ov ; de  us  with.  Usually  their  only 
inquiries  are  about  the  assumptions  we  have  made  in  RLA 
calculations.  We  are  usually  happy  to  talk  to  each  other." 

“Sometimes  we  discuss  our  reasons  for  assigning  cost 
e I  erne  nt  figures  or  failure  rates  for  particular  components. 

As  I  said  before,  they  ask  for  more  justification  and  we 
provide  it,  that  usually  makes  everybody  hapoy." 

"I  th i nk  DMP  and  CAPPROJ  get  on  we  I  I  together  as  far  as 
sor t i ng  out  any  problems  with  RLA.  I  think  we  both  real i ze 
there  are  I  imitations  with  the  present  system  and  that 
CAPPROJ  is  doing  the  best  job  that  it  can." 

Part  3  -  Scientific  Rigor  of  RLA  Procedures 

1 .  How  important  is  it  that  someone  with  the  right 

background  does  RLA'’ 

Not  Important  -  3  Important  -  4 

Provided  a  person  has  the  right  trade  background,  and 
enthusiasm  and  be  I  lef  in  the  task,  he  wi  I  I  be  a  good 
analyst." 

"It  was  importarc  to  have  people  in  the  group  with 
p'evious  experience  in  HQ SC ,  especially  those  with  spares 
assessing  or  SORO  experience.  This  is  because  they  knew 
where  to  go  to  track  down  cost  data." 

"To  do  BlackHawk  RLA  you  would  have  to  have  he  I  icopter 
exper  ience  to  be  fami  liar  wi  th  the  terminology  and  the 
components  you  might  come  across.  It  is  also  handy,  but  not 
essential ,  to  have  some  HQSC  experience  to  know  where  to  go 
to  track  down  cost  element  data.  Mind  you,  provided  a  few 
of  the  analysts  have  HQSC  experience  they  can  find  the  data 
on  behalf  of  the  rest  of  the  group." 

"We  had  troops  straight  from  the  unit  and  troops  with 
HQSC  experience  working  on  the  BlackHawk  RLA.  The  ones  that 
did  the  best  seemed  to  be  the  ones  that  were  the  most 
enthusiastic  whether  they  had  HQSC  experience  or  not." 
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